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CHAPTER THREE ' 



THE R/D&I CONTEXT IN THE EDUCATION SECTOR 



A volume- length analysis of the educational R/D&I context is In preparation 
and Will be on file at the NatlonaX Institute of Education (NIE), In the 
chapter presented he^e, we summarize key points made in the lengthier 
analysis. Specifically, each of the 19 contextual features will be i:cviewed 
below to describe the context for analysis of the educational R/D&I system. 



It should be noted that much of this analysis is based on impressionistic 
sources • Impressions derived from immersion in the literature relevant 
to analysis of key features of the educational R/D&I sye/tem and impressions 
derived from the analysts' personal experiences, an^ familiarity with thejj 
educational R/D&I and operating systems. The lengthier analysis provides 
extensive citations And other documentation, as well as some^discussion 
of key points in need of empirical verification,. 



I, ENVIRONMENTS OF THE R/D&I SYSTEM 
1, Vulnerability . j 

A. A Public Base 



A, 



Of all the sectors we have considered in our comparative analysis, education 
Is clearly the most vulnerable the most open to (and subject to) 

>sodial and political Influence.^ ^ As piiblic service Institutions sup-**' 
ported by public fun^s and adm^il^tered and regulate^^ by public ^agencies , , 
schools affect all subgroups of) the population (^s citizens and taxpayers). 
Since the proportion .of local funds spent on public education tends to be 
quite high, schools tend to be particularly salient to taxpayers. For 
those taxpayers who are also /parents of school-age children, the level 



of concern about •chool fuactlonlng tond« to btt ovoa higher Amtxlciin 
g o cl e ty h a >a bgen -H;h^g^^^^ie4-b j tr e roendOualy Mgli uxpcutntiona to t 
achooltna. The bu«lnoso coiiMnunJL ty , too, haa^aen oxproaalng great concern 
about achoO'l functioning, bemoaning the poor quality of work force 
preparation for the .world of work . 



B, Coals ^ • 

Education, by Its nature, also hai more dlffusri goals than other sectors 
goals. that «ro more subject to value-laden Judgments, misinterpretations, 
and controversy^ goals that ar^s harder to specify^ less measurable, and 
harder to use as performance standards against which to Judge system, 
performance. In comparison to other sectors, then, the functioning and 

effectiveness of educators, educational R/D&I p^rgoiuiel and the educational 
ayatem as a- vrtiple ' are more likely to. >e subject" to scrutiny and debate. * 

C. Legitimacy Problems 

Contributing to the vulnerability of the education sector is the educator's 
legitimacy problems in claiming specialized expertise. and professional 
status. Compared to scientists, engineers, doctors, or lawyers* the 
specialized training needed to function as a teacher or principal does not 
seem particularly, awesonte. From their own persdhal experience (as \iell 
as close observation of the experience of others), the public has n^re 
familiarity with whajt the educator, does (as compared to knowing what ^ 
engineer or a lawyer does). Therefore, particularly for" the better educated 
parent, ^here is far less o^ a gap in expertise between th^ general 
public and educators than between the public and. professionals in field^ 
with strong knowledge or technology bases. Similarly, 'compared tfo fields 
with well developed knowledge and technology bases and. highly specialized 
development activities (ejg^.r engineering), there does not appear to be ^ 
much of a gap in expert ise ^between the R&D personnel who develop many 
of the learning materials on th^ market and the teachers who develop 
their own materials, or eVen parents who peruse the materials used by 
their children. * . , v . ^ . 

. ^ * 

■ c ■ ■ ■ • 
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D. *The Nature of Educational Innovations 

— W- ' ' — — — ^ ■ • •' « ■ ^ 

Wddine to the* vulnerability* of ^educational R/D&I is the nature of*' 
•■ \ , ^- .■ / ' , • ... ' ■ 

educational innovations^, as compared -to j^the more technologial outputs 

df R/D&I^fey§tfeTfi^ ^in oth^r secto^^ where ,^R&D products are eas'ily 

pfi^ckaged"kT^5^;ins tailed; where use rarely conflicts with the values,' * ^ 

attitytfl^i '"^ah^^^^^ of operating system ^ersomel; andiTirfiere 

produ<^s capT be expected to' behave reliably in- accordance with their 

performantfe" specifications- (as long as thfey are used properly). Educa- 

* tional innovations', in 'contrast, tend to involve "people change" — 
e.g.: creation of hew capabilities or organizational strategies 03: 
instructional approaches* They are therefore more likely to be resisted 
— by the people who make adoption decisions and by those who must 
implement them. As "people change" products', there is far greater 
reectiveness between? 'product and Risers (both school personnel as 

\ intermediate users and students as end users). Therefore, implementa-" 

' tion is mofce difficult, and effects are far less predictable. Even 
when effective, educational innovations are harder to proVe effective — 
thfeir effects are harder to demonstrate objectively and are' therefore 

. more subject 'to dispute. Further, there may be controversy over the 
desirability of intended effects- / 

E. Weaknes.s of the g'cientific and Technological Base .* ' 

The weakness of the scientific and technological base of education and^ 
educational R/D&I is at\he crux of much of the environmental vulnerability 

of this sector. Though it shares >muc!i common ground^ with the social 

sciences and other applied social scieijce fields as well, education is 

-particularly vulnerable here. For example, we may note the following: 

1. The development of a jknowledg^ base in the social sciences and 
•applied fields like education involves research on humans rather 
than non-humanis, and this raises numerous value questions about . 
what should be studied and how;^^^* the ethics of research; 

safeguarding the rights of those studied; etc. 




2. /It also entails greater uncertain 

'"'^lE^lnce the humans studied (unlike rocks or molecules) have and 

fetcise free will, and are thus' "reactive" to innovations. ^0) 
5refore> reliability issues^ become particularly troublesome. 




*3m /There is* also a greater :^ikelihood of bias creeping in through 
^^T the researcher's own biases or the quality of the interaction 
' between rese^rdhet 'and subject. 

. 4# Experimental designs calling for randbmization or various kinds 
of controls are also less* feasible witK^humans, especially in 
field settings^as opposed to laboratory research. ^^^^ 

2> Governance Structures , * . 

A. ^^r^e Value Problem 

The value-laden nature of education and educational R/D6el is particularly 
problematic, given the governance^,>fe*iicture^of education and educational 
R/D6cI. School . system^ are legally controlled by agencie's in' their 
environment. Both school systems and educational R/D&I institutions are 
^ largely dependent on these agencies for their funding. Legal control ov^r 
tne operating system is vested in lay boards of education, elected (or 
appointed by e^lected officials) in each of the approximately 17,000 schc^ol 
districts^ across the country./ This lay control, its relationship to 
political processes, and it^ extreme decentralization are factors of 
some consequence. Although professional (i.e.; the Superintendent) 
dominance of lay boards is the rule, there are frequent exceptions. 
Especially . in .controversial aneas (e.3.; busing, sex. educatiSI|||||f , unless 

the Superintendent is a peri^n with strong leadership abilities and<a 

clear vision of what he or she wants, community pressures can have a 

... V • 

* ^nsTjor impact on school functioning. 

B. ' Formal Governance Structures ^ * 

: ■ • ■ .. ■ ■ . ■ 

In terms of formal governance structures, the educational system in^ the 
U.S. is characterized- by extreme decentralization. In contrast to 



centralized systems (as in France, fpr example) which haye centrally 
prescribed courses, textbooks and learning materials, centrally developed 
examihatlbn systfems, iand extensive^ monitoring of. school operations by 
school inspectors, each of the thousands of local school districts 
In this country is largely autonomous. Though legal authority to 
regulate schooling's, vested in th'e goyeHrnments of the states, few if 
any states actively monitoi: school functioning, and on the whole^ local ' ' 



districts are highly autonomous frofai state and federal authorities. In ; 
operational terms, decentralizatid^a^ tends to go considerably beyond the* 
decision making autonomy of the districts. Within each district there Is 
considerably autonomy ^at the the local school* level,' with the principals 
(and also teachers) having a great' deal of leeway in determining what hap- 
pens' in their 'classrooms. This degree of autonomy down to the schgfel and » 
classroom level is a factor of considerable importance in explaining 
why innovatipns that are formally adopted by a school district ^re so 
often not implemented in practice, or are so .transformed duriilg 
implementation that they amount to little more than "the samiB old 

■ ' ' ■ • '/ 

C. Puhding Control ' / ^ ' 

■. ■ . ■ ■■/■■, 

In the case of the educational R/D6el system, the ultimate, control over 
decisions affecting funding and therefore R/D&I functioning — is ^ 
the Congress. Given the history of Congress ' s lack of confidence in the 
ability of- educational R/D&I to provide a reas^nalxle return on the -taxpayer 
investment,' thi& has -meant almost constant troubles for the R/D6cl system. 




3. Economic Forces 

Economic forces in the environment of the /educational operating and R/D&I 
systems have begj^felt particularly seve^ly in recent^^^ears,. On the state 
and local l^vel, school financing has become one of the ^paramount issues 
of the day. We find increasing numberis of cases of states and local 
communities struggling over equitable financing formulas; states cutting 
assistance to local districts as they struggle with their own financial 
difficulties; and voters in local diy^tricts defeating school budgets and 



bond issues in an effort to stave off further a^creases in local taxes. 
Economic recession has also meaAt a shortage'' of 'slack resources in^ 
the private sector to invest in high* ris)^ low "return R/D&I activities. 

Summary; Weak Supports and Assertive Dem ands 

■ ■ ■. ■ : ■ ■■■■■■ ■ . ■ " . ^ . ■ ■ ; i - : 

In all, we can characterize the environment o£ ^e education sector as one 
that tends to be weak in supports for the system/ and . assertive in demands 
about, what can or cannot be done, should or should not be done. R&D in edu- 
cation tends to lac^ prestige or Illegitimacy ^ven a strong demand for k 

... • 

its products or its very existence.^ This seems^ apparent whether we 'focus on 
the attitudes of researchers 'and scholars in the disciplines, educatibnal , 
practitioners, laymen*. Congressmen, or even the education research and R&D. ^ 
communities. ' The system appears to have developed no strong constituency of 
its, own and is buffeted by the initiatives of various othelg^>constituencies 
able to articulate demands reflecting broad social , cultural, and political 
movements in the society as a whole (e.g,; integration, ethnic conscit>usness9 
feminism) . ' : ^ ' 

The environment of the education sector affects virtually every feature of the 
R/D&I system — the definition of goals, needs, and strategies; the level 
and quality of personnel, funding, and other Resources that flow into the systen 
and the functioning of the system itself (what research problems or R&D topics 
are attended to; the manner in which problems are defined; the amount that 
must be invested in early phases of R&D activity because of the weakness of 
the knowledge base and the transforms between stages;, the controls that |Ste 
exercised over research to protect human, subjects; the credibility of tWe 
research and R&D effort with different constituencies (a^ evidenced for instance 
in the numerous examples of the black community's unwillingness to participate 
'in survey research in the late '60s). No other sector we haye considered 
in our comparative analysis is confronted with such serious environmental 
pressures. None is as dependent on environmental institutions' for its support. 
And none is dependent on an environment so inimical to its chanced for develop- 
ment and maturation. 



'II. aisTORicAi;. DEVELOPMENT ^ ' • . 

• ■„ "... ' ■ ^ -r. , : : 

1> A Newly Institutionalized System ^ * 

The development of instructional' strategies and learning materials has been 
going on as long as there have* been teachers and students, 'and wes can find 
'examples of institutionalized educational research In this country over a 
relatively long historical period. Nonetheless, we must note that institu- 
tionalized R/D&I In education is only a little more than a decade old. That, 
is to say, hew to the field of ^ucation is Institutionalized, linked R/D&I 
as an Interrelate^' set of processes revolving around the development function 
and carried out by specialized personnel under specially designed^ organiza- 
tional arrangementiB. While the newness of a system may not -be significant In 

' itself (few institutionalized R/D&I systems in any sectors are more than a few 
decacles old), it is a ^factor of some cojisequei^ce when compared to the centuries 
of history and tradition that characterize the operating system of educational 

'institutidns . The o]:>erating system served by educational R&D is old in history 
and hea^ly laden with traditions, norms, and values that run counter to the 
acceptance of outputs of external R&D. 

Thus, the educational R/D&I systeiaa has, not yet. established i^s legitimacy. It 
competes against traditional approaches to producing knowledge, programs, and 
products for educational institutions — and it uses scarce resources.: Its 
methods and outputs have not yet proven their superiority to traditional method 

^nd outputs. In many cases, the products of educational R/D&I appear to be 

'ci^arly^^i^^ to conventionally developed products.' 

There would? seem to be abundant evidence that the system^s present state of 
maturatioa-T)laces It within the boundaries of the introductory stage of 
historical development. It is a relatively young system. As we will discuss 
later in this analysis, mah}^ functional specialties of mature R/D&I systemfifty 
are almost totally absent in' edu^cation. Those that do exist either ^dUerged 
as areas of specialization after theyR/D&I system was institutionalized in 
the'.mid-'60s, or were wholly transformed by the demands of that system. The 
functional, specialties provided in the— specialized R/D&I institutions exist 
alongside of ^ — and compete with — similar activities carried out in 



the other, older parts of the' education sector/ The system has been chJIr- ' 

acterised by a high levels of instability in both macro ^nd micro level . . ' 

' ' ' ■ ^ ' * ■• V ■ • " ' * ^ y • ■ 

's^Bkmctures. Neither its funding nor its personnel* bases have been adequate - 

to th^f demands of system functioning or appropriate to the quantity and 
quality of outpu;ts 'expected by thd systeto' s sp(&n;sors. The field's know- % 
ledge dn4 technology base is inadleqtiately d^te^•fel^oped• R/D&I functioning dn 
education been j i^mp ered by amorphoush^ss oflstar^dards; ambiguities i<a 
defining vork role3^,^B|^ requisite skills and cosnpentencies; and inadequacies ' 
In information flw^ , The knowledge "producing an^^slcnov^Ledge com- 
ponents of the. syistem are poorly integrated. System* outputs have beer^^ 
generally low in qualify. 

2. Critical Events 



A. 1954-1972 




A number of critical events have shaped the system, brought it to its current 
point of* development i and continue^ to obe felt as constraints on sy»£em fiin^c-^ 

tioning. The most ^significant Events in thef birth of institutionailzed R/D&I 

in education are: (1) the emergency .c^*^ the federal government as th^ primary 

sponsor of educational R/D&I in the miji-'50s; and (l) the enormous CHcpansion ,of 

federal funding -programs in the '60s. iffhe most impbrtanjt legislation has been: 

(1) the Cooperative Research A9t (1954 and subsequent amendments); (2) the 

National Defense 'Educatidn;;Act (1958) and (3) the Elementary- and Secondaty 

• * (39 93) ' 
Education Act (1964). * Through these pieces of legislation, the federal 

government created major new funding programs and also created a network of 

new Office of Education (OE) funded institutions which were separate from the 

existing bases of R/D&I activity and external to the operating* system. 

• ■ ' . . ■ > 

The new network of R/D&I insti^j^^s external to the operating system in- ^ 

eluded': university-based R&D ceri£ers^, regional laboratories estalt^lished in 

the form of quasi-public corporations located in non-university settings; 

ERIC clearinghouses; ESEA Title III demonstration centers; and various kinds 

of material's centers. Although both the laboratories and centers were ex-' 

pected to carry, out activities covering the full range of R/D&I activities, 

the academic locations of the centers suggested that they would be partic- 
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ulaily 'Well sulteoi to ced^^t research *and prototype development;' the 
r ; — ■ , ^- • ■ ' . 

•laboratories,' as' i»sfituti6ns 'apart from the research -subculture of the ' 

universities/ were escpected to be in a. better position to attract ful,l-time 

*• * * ■ ^ , f. ' 

•development-oriented personnel, and were therefore expected by many to carry 
" out imich of the system's R/D&I activity. oriented tqwafd .full development, - 
t^kting, and paclcaging*of prototyped ihtp usable, products and program, paclj:-' 
ages, J^s* ^t turned out, especially in the initial years of fynctioning oi^ 
the new network 6f institutions , there was only a limited amount of this 
functional specialization, ^nd (with som^ exceptions) the l^aboratories aifd 
centers operated independent of one another ''s work, each attempting tO'caj 



out the full range of research, development, and dissemination work connected 

with, its products. Adding this ^picture o^v^minimal integration among system 

Institutions, the disseminations-oriented institutions in the system (e.g., 

the ERIC clearinghouses, ESEA Titl6 III centei^s, materials centers, etc.). 

tended to define their agendas and carry. out their activities in ways that 

were for th0 most part . unrelated to the work of thi^laboratories and centers. 
High quality outputs were expected to material izeyquickly. from this new net- ', 

.^ork of institutions and to IJ^e immediate arid widespread impact on school 
system program's and practices. Wheg^. this goal was not achieved within only 
a few years. Congressional disillusiotiment set in; large numbers of lab- 
oratories and centers lost their funding and went, out of existence; and 
educational R/D6el appeared to beVln de^p trouble. (There were 13 R&D centers 
and 20 laboratories by 196/; by 1972, only 23 of these 33 remained; by 
1975, only 17 of the 33.)^^^^ ^ , . 



The educational R/D&I system,' as that system is generally conceived today, 
encpn^asses an institutioitail base considerably broader than the labs and 
^C^^CTs^and pther -^specialized R/D6el ins titjjtions newly created by the' Office 
\ifS^^^y^^^^i^ovi in the .*60s. It includes work carried out in academic insti\ 
tutions, in the private sector, in federal, stare^^ and local agencies>^.£j:<lV^^^^ 
And recent analyses of the fedetal gov^rfKept's sponsorship cof educational 

R/D&I activities underscore how many different federal agencies jand'programs 

(76 77 78- 102) a 
fuAd educational R/D&I. efforts. ^ ' > Future histories of ed-' 

ucational R/D6el, and especially federal sponsorship of educaticpal R/D6el r , ^, 

•activity, are likely to meet the as yet unmet need for analysii of significant 

patterns in R/D6^l functioning in this broader set of R/D6el eiM-forme^ s and . 




„ ■ ■ • ^; ■i---/.;- ^ .•. -196 - ^ . ■ . . 

sponsors, At> present, -however, based on available pytblished sources, there * 
is relatively littfe that we can say about how this broade^^st'em fared 
in the •SOs, and early. ^Os, Still, what,ever picture of educational R/D&I 
in these -other settings' V?y. appear in some futjire histories,* the visibil^^ty 
.of OE funding 'for edlicationiil^R/D&I in these years (in contrast to funding for 
suchrwor^ from otl^er agencies) , and the close association in the minds of 
. many ye.&, ; Congr^ss^ional ^critics , practitidiier critic^, '^etc.V between the 
labs and center^ 6n the ori|^ hand and the sum total of educational R&D on the 
other suggest- t^ failutes, and fate of the labs and centers 

in theie early yea^ps^might affect the broader educational R/D&I system and 
its sponsorship for 'some time to opme regardless of whatever may be learhed 
subsequently about the broader systep, its ^functi9ning,^^and its outputs. 

The ups-and downs iri^ Administration and Congressional support f6r educatio? 
R/D&I have had a critical impact on the s'ystenf sincev. there are so few other^ 

bases of R/D&I funding, ^Jhe R/D&I funding that comes from piMvate fouodationa; 

' * : . ■ ^ ■ •. ■■ J,'' '- ■' 

is small in comparison to the slims invested by federal agencies^ (In FY l96Sy ) 

private foundations jarovided approximately $7. million of a- $192 million doc-^^Mt/ 
uiaented minimum base of financial suppo^ for educational R&D* ^^^^^ Fot Fy'^^^^ 
J.975, private foundation^ were estimated to prpvjfde $57 million to $65omilf^|7 
of .a total of $605 to ^673 million of educational R/d&I funding in this^ 
country^; ^ ^^?) ) Furthermore ; potential bases of ^ funding the educatioh j^^^ 

industriies, entrepreneurial firms,; state and local educational agencies 
ha]ye until recently failed to allogate substantial resources to R/D&I activities, 
and even now |tje amounts that come from these other potential bases of .funding ' . 
are :relatively small (somewhere between $35 and $85 million annually) .^^^^ 

B, 1972 - NIE 

The educatidcxal R/D&I system was given a brief reprieve J^rom what appeared 
t(iSc an inel-lt-able premature death. In 1972, the National Insititut^ of 
Education was created, and control oyer many of the OE-sponsorep R&D programs 
were transferred to this agency (especially those programs like \^v^^abs 
and centers program which had' come under Congressional' ajttacTi) . NIE waa 
^given a leg^s^lative mandate "to buil^ an effective R^D systeml" Implicitly, "- 
it appeared that NIE was to become' the lead agency for the federal governpient 
sponsorship of R/D&I in education and that .its fat^ would become synonyrnous 
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with educational R/D&I ^ — as had the OE-sponsored labs' and centers program 
In the • 60s. ^ ^ - * 

Unfortunately, the Institute itself encountered al^iost immediate problems 
. > of its own, the most serious of which were its appropriations struggles 
.f.l with the Congress. In 1974, fe4eral funding for NIE (obligations) was clit, 
' from $106: 8 million In FY 1973 to $75.7 .million in FY 1974, p figure lower 
than ^quivaleI^t OE educational R/D&I program allocations had been since 1965. 
The zero funding recommended by the Senate threatej^4. the very existence of 
NIE and implicitly educational R/D&I in general. Since 1974, NIE's funding 
status appears to have stabilized (albeit at the rattler modest $70f million 
level). Still, the key barometer of this relationship for the near-term 
and long-^term f uture^ls likely to be- the extent to which the Agency succeeds 
(If indeed It does at all) In substantially Increasing Its appropriation. . 



NIE has beefn in existence for only a few years, and efforts .to contrast NIE 
policies aivd orientations with previous federal educational R/D&I policies 
are hazardous given how little evidence is available 5bout federal. 

^ . ^ . ^ % 

sponsorship of educational. R/D&I activity outside .of OE and federal funding ^ 
targetted at instltutlpns other than the OE-created labs and centers. Still, 
our observations and impressions .of federallj^sponsored educ^io]|g|l R/D&I 
functioning In the pre-NIE decade, and subsequettt period suggest the following 
strong points In NIE's favor that seem to warranfcSnention, 

: V-/. . . ' .-.'•>• 

In contrast to OE policies in the '60s that focused so much attention on 
the labs and centers, NIE policies and programs appear to* have restored 
greater balance to overall system development. By supporting both the ti>a- 
dltibnal bases of R/D&I activity (academic Institutions, private sector organ- 
Izatlons and the operating system) as well as the new institutions that emerged 
* in the '60s,*NJE has been supporting sources of, educational innovation* that 
are both Internal and external to the user system^ NIE program funding em- 
phasizes not only research and development activity (as did OE in its funding 
of the labs and aenters), but also dissemination, delivery, and building 
Internal user system capabilities for need Identification, 'development. 
Implementation, and utilization. State education agencies have been taking 
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Increasingly active leadership roles in dissemination and in .providing 
technical assistance to school systems. NIE has al^ been emphasizing the 
role of the state education agencies as. key sources of •leadership in these 
% areas. * ^ . ' 

** . ^ ^ * . . • > 

But NIE has not as yet developed a strong constituency within the research 

and R&D communities and among the powerful education interests and lobbies • 

Consequently, educational K/D&I .continues to be buff.eted by environmental 

forces, with li*ttle prestige or clout of its own to buttress it against 

environmental pressures that impair system functioning. Educational ^R/D&I 

, • • 

has been. likened to a tree that is planted and then torn out by the roots 

every couple of yeiars to see how it is grdwing. To understand why this has 

been so, we must examine the environment of educational R/D&I. 



■■■ u : ■ ' • ■ 

III. INSTITUTIONAL BASE (NETWORK OF INSTITUTIONS) 

• ' - * 

Analysis'of the structure of the educatiional R/D&I system suggests the existence 

of several parallel subsystems characterized by minimal specialization, consid- 
erable redundancy, looped as well as adjacent clusterings of functions, major 
gaps between functions, and inadequate linkages among subsystems as well as 
functions. The overall structure is diffuse, much of it lacks f orriialization, 
and whatever centralization or coordination might seem to be inherent in the 
dbminant role of the federal government ^ in R/D&I sponsorship is more potential 
thten operational at this time* ' 

The focus of ou^ attention here « is on the netwoiak of institutions that carry 
out R/D6cI activities per se rath^F~th"ah either the superordinate system 
that provides resources and contraints and accepts systeitTou^puts (i.e.: the 
federal and to a lesser extent state agencie^/^d private, foundations) o^^ 
the subordinate, system of mostly ^ector-sj^anning organizations that provide 
support services >(^.g.: data processing service bureaus, equipment 
suppliers, maintenance firms, etc.). . 



ERIC 
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1, Parallel Subsystems Within the R/P&I System 

«f . 

The structure of the educational R/D&I system is, in reality, a set of three, 
parallel subsystems. 

• ■ * ^ -v- 

A. Colleges ^nd Universities . ^ 

One subsystem is made up of various organizational settings located within 
the. colleges and "universities — schools, colleges, and departments of 
education; educational research bureaus; various academic departments 
in the social sciences and occasionally other disciplines as well; and • 
university l)ased interdisc^linary research centers and institutes. 



B. Quasi-Public and Private Sector Institutions 

A second subs}stBm parallel to the first is made up of the large and ' 
proliferating njamberl of quasi-publlfc anid private sector institutions 
currently engaged in educational R/D&I — the federally funded 
regional laboratories, R&D centers, ERIC cle^ringhquses , materiats — 
centers, etc.; non-profit and for-profit research corporations geared 
to the federal grants and contracts ecanomy;^ organizations from private 
industry that have been making tentadl^ forays into educational R/D&I; 
and others such as publishers and audiovisual firms' that have strong, 
establjLshed footholds in the education sector. 

C, SEAs, ISAs, and LEAs . 

The operating system o-f State Education Agencies (SEAs) , Intermediate Service 
Agencies (ISAs) , and Local Education Agencies (LEAs) are so weakly linked to 
these other two subsystems, and often so redundant with them in the conduct 
of R/D&I activities, that we have identified the operating system as a third, 
parallel stream ratheir than as the KU target of KP activities in these qther 
two streams. 



ERIC 
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D, Lltdcages Wtthln Each Subsystem '\ \ 

Within, each of these subsystems there is\some interaction of a more 
or less informal nature — but far less t^an one waul d imagine given 
the physical proximity of organizational u\^its within the academic . 
setting; or given the operating system!^ formal govemante structure 
that would lead one to expect to find extensive interaction arid moni- 
toring between: SEA and ;LEA personnel; or considering' the commonality 
of interests thkt woul^, lead one to expect extensive communication 
among, schools or between LEAs and SEAs. . \ 

ISAs represent a new development aiifted at Increasing linkages among 
school districts, and between school districts a:nd their SEAs. Aside 
from this one exception (and even here, only some states have created 
ISAs and these tend to be quite new) , linkages within each of the 

three subsystems are incidental and informal rather than institutiona- 
lized, permanent, and strong. Consequently, communication and informa- 
tiotv floW are weak, and knowledge production and utilization are in- / 
efficient and far less effective than they might otherwise be. Develop- 
ments in social science departmentis tend to have relatively little im- 
pact on developments in schools of education. BE^^^ttvlttes in one 
research corporation have little impact on R&D activities in others. - 
As yet, local innovations in ope school district sefen^To'irave little 
impact on practices in other districts. 

E. Linkages Between Subsystems . 

Equally (and perhaps even more) serjLoiis are weaknesses in the linkages 
among these parallel subsystems . The academic community tends to func- 
tion in relative isolation from both the operating sysjtem and tjbe re- 
search^orporations that dominate R&D activity. Consequently, the re- 
search findings produced by the universities have relatively limited im- 
pact outside that subsystem. The operating system is li4iac^ to publi- 
shers and equipment suppliers in the private sector but^, otherwise general 
ly develops its own programs and materials and tends more often than not 
to operate as though there were no educatipnal research community, no 
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relevant research flndl^s, and no externally developed R&D .products 

" • (9 51 54 57 139) 

and programs. * > » > / rpj^g general pattern in the regional 

laboratories and the research corporations is to develop products and 
programs in relative isolatiotl from either the academic community and its 
accumulated knowledge bas.eor.the user sjrstem and its perceived needs and 
constraints^ There are notable exceptions, of course, and some strong 
■ collaborative arrangements have been forged in aumher of instances (e.g.: 
Northwest Regional Laboratory in relation to school districts in its region 
But on the whole, individual R/D&I institutions and organizational units 
tend to function in isolation, linked weakly if at all to other institu- 
tions ,or. units or their immediate subsystem or other subsystems in tj^e 
macros true ture. ^ ' 

2. A Linear Model in Theory but not in Practice 

A. A Low Degree of Functional Specialization . 

The linear model that is now in general disrepute ^ut se^ems to have been 
a significant influence on much bf the early R/D&I thinking in the '60s 
assumed that a "natural" specialization of functions and a pass-it-on flow 
of R/D&I activity would emerge in the '^relationship among^ theses subsystems. 
The university subsystem seemed inherently suited to re^arch;-' the non- 
. university corporations seemed designed to meet the needs of programmatic 
development work; and the operating system was viewed narrowly as the 
target to receive the outputs researched in the universities and developed 
in the corporations. Functional specialization was assumed, as were the 
linkages, two-way interactions, and knowledge feedback flows required for 
an integrated system. To whatever extent the li-near model may be accepted 
as a reasonable description of R/D&I configurations in any other sector, 
empipi^^a4r^rf ality in the education sector reveals a somewhat different 
"picture. • ^ 

The relatively limiHed degree of Specialization and extensive amount of 
redundancy that characterize the educational R/D&I system can be seen in 
the location and clustering of R/D&I functions in. the various institutions 
' that make>(^' the system. The greatest amount of specialization occurs at 
^the ba^c research end of., the educational KPU spectrum, with most basic 



reses^ch concentrated in the universities and especially in the academic 
departments. Some basic research is^one in some of the larger, wealthier, 
and more presti&ious corporations (e.g.: Educatioiial Testing Service) . 
• But for the most; p*art, basic ' research /s th6 private preserve of the uniyer 
slties. /■ ' ■ ^ 

' '• ■ - :,: ' ■' ■ - ' : • ■ •; ' 

Applied researph,^ howevferV Is carried ^oMt in one fo^ or andth^r ia ^ 
research, inStitu^ins or units 'scattered throughout all the various typ^es 
of organizational settings lir the system — the universities; the R&D 
centers and. regional laboratories; the research corporations; and even 
some of the strong SEAs and big-city LEAs that have the resources to carry 
out policy research as part of their long-range. planning* and monitoring • 
efforts*. 

' ^ . ' • 

The bulk of federally funded development work is carried out in the 
regional laboratJOrles and the large research corporations. However, ^' 
development* work in .one form or ^mother takes place In virtually 
all types of organizational settings in all three subsystems. Similarly, 
dissemination and evaluation contract^ are being awarded increasingly 
to institutions , located in only certain segments <Aj^e. overa]^ structure 
(dissemination contracts Increasingly to SEAs and organizations working 
with them; evaluation contracts increasingly to the research corporations). 
Nonetheless, dissemination and evaluation activities, too, are carried 
out in one form or another throughout the structure, even in organiza- 
tional units within the superordinate, structure of federal and state agencie 

If we consider the implementation and utilization support functions, what 
little linkage specialization exists to provide user system personnel with 
"^technical assistance in building internal capabilities or implementing 
externally developed R&D products, tends to be located either in new 
linkage and technical assistance organizations (generally small non-profit 
corporations) or in the hands of a smalj|^ group of staffers from a 
laboratory or R&D organization that is trying to install one of its 
products. Still, even here, careful analysis uncovers some lii|kage, . ^ 
technical assistance, and implemantation support activities in the, 
universities, in some of the stronger SEAs, and in LEAs and' individual 
schools well endowed with curriculum specialists and other specialized 
personnel. y 



Overall, then, functional specialization among education R&D organizations 
tends td be somewhat limited, w^th most of these institutions encompassing ^ 
several R/D&I functions. The pat£]&^Vis not only one of limited functional 
specialization, but also limited specialization in substantive areas of 
R/D&I activity, Basic researchers tend to become specialists in narrowly 
defined research areas and subjects of investigation. However, applied 
researchers, developers, evaltoators*, disseminators, and implementation 
support personnel tend to be generalists within their functions— 6,g,: 
one year evaluating cotapensatory education programs; the next year, 
examining the ef fectiveyiess of alternative^ dissemination strategies; the 
next year assessing the quality of ERIC information analysis products, etc. 
Within a few months time, a single large R/D&I organization within the educa 
Aon sector may respond. to RPPs and bid on and.be awarded contracts covering 
the whole range of functional specialtTes and an array of topical areas; 
and some of the samj^ personnel maybe assigned to work on several of 
these rather different contracts at the same. time. Some of these 
organizations may also be working on contracts involving R/D&I 
activities in fields of health, personnel development, social welfare 
programs, etc, ['^Clearly, this pattern is at considerable variance If rom- 
a sector like the aviation/aerospace industry where there is highly 
developed' special izat ion by fiinct ion, by component s (e • g , ; airframes , 
engines, electronics), and even by R&D problem areas (e,g,: wii\g 
stress analysis), - ^ ' * • 

■ ^ ■ 4i 

B, A High Degree of> Functional Clustering 

Examination o*f the clustering of functions within R/D&I institutions 
reveals, not surpriitingly, that basic^ research is , the most specialized 
of the various functiohs and the least likely to cluster* with any of the 
others, ' This is attributable to the nature of tHe knowledge and tech- 
nology base of the basic research function; the socialization and 
.training of its personnel; an? the .values, norms, and mores of the 
university set:ting;s in which it takes place. If we ignore basic research 
and consider the remaining R/D&I functions, we find several forms of 
both adjacent and looping clusters. 



A significant amount of clustering surrounds the development function ^---d 
e.g.: ' applied research and development; development and dissemination;, 
development and production of support materials for implementation/ 
utilization, and even development/dissemination/implementation clustering. 
The clustering is the outcome of conscious policy decisions of educational 
R/D6cI managers^ A less :^ormalized version of the same kind of clustering 
(minus dissemination) would be represented by the creative teacher who 
generates* an idea, gathers relevant information, develops it into a 
teaching strategy and instructional materials, and then'^uses them in 
her classroom. 

. ♦ * • » ■ 

Dissemination and Implementation/utilization clusterir)^ is becoming 
^increasingly frequent as a result of the knowledge bo^e and personnel 
base that spans these: two functions and as a result of thet kinds of: 
organizational arrangements, that are being created by "explicit and 
Intentional policy initiatives of federal and stal:e agencies (e.g.: trainin 
programs for dissemination and. utilisation specialists; state creation of 
ISAs to provldfe dissemination and technical assistSnce services to school 
districts; NIE's R&D utilization program j etc*). 

Applied resear^ch and evaluation were a natural cluster during the first, 
few years of the emergence of the evaluation' research function, largely 
because evaluation personnel were trained as researchers; were Interested 
in conducting Research rather than e^jaluation; were forced into evaluation 
work by the operation of the laws of personnel supply and demand; and 
tended more often than not to piggyback re^search projects ^nto required 
evaluation activities. As evaluation has matured and developed an identity, 
methodology, and personnel base of its oWn,Jth*s baiBls for l!he research/ 
evaluation cluster has tJeen leSs prominent. Still, there are several 
examples of well-run R&D pMgrams where questions uncovered in the course 
of product or, prograiji evaluations are turned over to research^ personnel 
for further investigation oriented toward future development cycles for , 
further product refinement (e.g.: in the development of the Individually 
'Prescribed Instruction' Program by the Learning, Research and Developilient 
Center and by Research for Better Schools). 



One of. the newest clusterings to appear is a utilization/research cluster 
that may lead to maturatioii of a* practice-oriented research specialty 
(as illustrated by work now in progress by the Center for New Schools 
to document and analyze nine^LEA local problem solving projec^ supported 
by NIE) • ' * 

Equally new is a utilization/development/dissemination or utilization/* 
dissemination, cluster evident in projects to identify exemplary practices. 



6cument and an^Ti^^ze them, use them as the basis for materials develop- 



ment, and disseminate these practices and materials to other potential users 
The configuration is changing somewhat as more and more resources are 
being allocated to building linkages. Initially, this took the form 
of temporary collaborative arrangements and joint ventures for individual 
projects, joining together ^institutions \d.th complementary capabilities 
or functional specialties. Increasingly the consortia and networks that 
are being pi^oposed and experimented \ri.th are intended to be permanent, 
formalized interface arrartgenlents providing either horizontal integration 
(linking" similar institutions or organizations) or vertical integration 
(linking functions and/or subsystems) . It will be some fcime, however, 
before we can expect to see the effects of these initiatives ^on the 
configuration of educational R/b&r institutions. ' 

3. A Final Point: The Place of Large Corpbrations ^ 

One further point: <sKpuld be noted before we, leave the topic of'^e structure 
of the R/D&I system in education. Several large corporations appear to have 
particularly' strong positions in the grants and contracts economy of the 
education sector — e.g.: American Institutes of Research, Rand Corpora- 

tion, Stanford Research Institute, and Educational Testing Service. In fact, 

> ■ <. • » , ■ . # . 

in the period FY 1973 - FY 1975, fewer than 50 organizations received the 

f93) ^ ' 

majority of NIE fjinding support. ^ Still, the number of R/D&I institutions 

■ ^--^ ^1 

receiving funds from all sources is substantial and it wbuld seem unwarranted 

at this, time lo suggest that certaj.n types of R/DSI In the edudation sector 

are dominated by a few largQ institutions in a pattern resembling the aviation/ 

aerospace industry. However, we will be in a better position to asse^ this 



question after the NIE KPU monitoring project provides empirical data about 
the Individual Institutions that carry out educational R/D&I activities, 
important for understanding the emerger^t configuration of educational R/D&I 
Institutions and for developing appropriate policy Initiatives and strategies 
for macrosttucture management. 

IV. GOALS > POLICIES. STRATEGIES 

1. Weaknesses * 

Educational R/D60[ has been criticized repeatedly^^^r weaknesses In goal 

setting, priority determination, policy formation, and strategy develop- 

(49 73 83 103 128) 
ment.^ ' ' ' ' ^ Given OE's and now NIE's status as the dbmlnant 

s^QQSors^and primary Influences on educational R/D&I, It Is goal setting In 

these agencies that must be the focus of our attention. ' 



On the most general level, the goals of federal policy for the system have been 
reasonably consistent throughout , the OE and NIE years. Using the current NIE 
formulation, these goals have been:^ to solve educational problems;' to 
improve: educational practice; to develop the ^knowledge and technology base 
neede^^ fpr these efforts:; and to develop an effectlvi^ R&D system. 

However, when analysis proceeds beyond broad goal statements to specific 
b policies, programs and activities of OE and NIE (and when spe^al note is 
taken of relative emphases in budget allocations), the picture that 
emerges is one of iriarked discontinuity, shifting %oals and priorities, and' 
policies 'And strategies that have not been entirely consistent with some of 
the system's goals. What has been lacking until recently has been adequate 
translation of broad goal, statements into Intemediate goals "knd objectives 
specific enough to guide priority determination, policy formation, and 
strategy development and specific enough to serve as benchmarks for 

measuring system performance. ^^^^^ Also lacking have been mechanisms to develop 
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consensus oa specific system goals^ priorities., policies, and 4i|D^tegies 
among the various constituencies affected.. 



^0 



2. Historical Patterns; Changing Priorities and Dectstonmakers 



Historically, there has been a close relationship between the dominant system 
goals and priorities, on the one.hand, and the pi^mary locus of goal-setting, 
on the other. 



A, Stage One; Research Emphasis 



1 




In the late '50s and early '60s when the dominant source ofi, funding >^as 
the Cooperative Research Act, system priorities were determined largely 
y the educational research community. The locus of goal-setting was - ^ 
decentralized, scattered among all the various researches and KP (know- 
ledge production) institutions who submitted field-initiated proposals 
and the prominent researchers who served on review a^d advisory panels. 
In a researchex^doniinated context,' research was rather naturally empha- 
sized.^ Development of the field's knowledge base was the goal of the 
system; funding educational research projects was essentially the 

strategy: and funds flowed primarily to the universities where educ^ 

(2S) ^ 
tional research personnel was located, k . 



B. Stage Two: Centralization and Short Term Emphases 

This pattern changed drastically in the mid-* 60s when OE funding emphases 
shifted from field-initiated oresearch projects to more bureaucratically- 
deflned, mission-oriented, programmatic R6cD. The shift was gradual. 

When the laboratories and centers were - first created, each institution' 

'■ - 

defined its own mission based on the areas of specialization of its 
... ^ » * ' ' ' ■ 

^ senior level personnel. Over time, however, with increasing OE use of 

^ RTFs and targetted research programs, the Xocus of goal-setting became' 

highly centralized^ as it shifted to key OE staff members, with some ^ 

assistance from their advjLsers,* whom they selected from the research 

(25) 

and R&D communities. . > , ^ 

' With the shift to a centralized locus of goal-setting, there was a marked 
change in goals and emphases. There wa^ <.less and less concern with the 
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field's knowledge base, and more and more attention to the shorter-grange 
goal of solvlhg immediate problems 'of the operating system. Those problem 
areas receiving the largest allocations of funds (e.g.: improving the 
.academic achievement of low-income, minority students) ^^^^^ weye defined larg 
by social and political forces external to the education sector — rather 
than by the dominant concerns of practitioners at that time, or by the 
needs of the^ field's knowledge base, or even by the state of development 
of the knowledge base, to permit effective attack on particular problems. 
The bulk of resources went to the development function rather than 
research. The tiniir^orlzons of the dominant goals were Immediate and 
short -rM^ed< The emphasis was on developing packagejable products\ 
LlmitedT^ attention was devoted to longer-term development of changes- 
process strategies or resource building: for enhancing R/D&I system 
capabilities* Concern with developing the field's knowledge and 
technology base had lost .center stage and was not only slighted --^ but 
many of the funding policies and strategies of this period were even 
inimical to this goal* Considerable resources went into building an 
institutional structure for a new, Specialized R/D&I system — but ' 
little*'9f that funding w^ used to develop institutional capabilities 
for longer-term system development. Proportionally less and less of 
available R/D&thy* resources flowed to the universities, and more and more 
went to the regional labbratordes and the proliferating non-profit and . 

f or-prof it^9rpiq{:^rations g^ar^ed. .tP-^the mark^tp^lace p£.-federal grant s^^ndX^ y—w 
contracts^- ^ ^ 

C. stage Three; NIE and Mixed Strategies * 

We made the point earlier that any complete picture of federal: sponsorship 
of educational R/D&I activity requires consideratibn o^f a host of federal 
agencies other than NIE — that despite NIE's rol^as lead agency for 
educational ^6cD, its FY 1975 budget pf $74 million represents only a small 
portion of the total federal FY 1975 investment of $513 million. However, 
there is. little in the published literature that is#hel^ful for developing 
a clear picture of the goals, priorities, policies or strategies of these 
othifer federal sponsors. Our impressions of t)\e contrast between current 
NiHrefepha'sels atid'e^^^ OE emphases may need revision after some future 

analyses are writj^n of R^)&I policies of all the relevant -agencies over the 



past decade or two* But for the present, since NIE Is the lead 
agency for educational R&D and the system* s most visible focus 
of policy determ^natioo, it seisms useful' to contrast what appear 
to be the dominant patterns in NIB goal-setting/policy determi- 
nation for the syat^em in the '60s# ^ 

Goal-setting and policy formation under NIE appear to present a 
^rather different pattern — a more collaborative mode and a mix- 
ed strategy of centralized and decentralized initiatives. Com- 
pared to the previous periods, the NIE approach appears to be 
less R&D-oriented and more market-oriented. Whereas the previous 
patterns emphasized flvB^t developing the field *s knowledge base 
(1954-64) and then solving educational problems through R&D pack- 
aging of solutions (1964-1972), the NIE emphasis ^ppears to be 
clearly on Improving educational practice. R&D activities still ^ 
receive a very large share of ayailable resources, but dissemi- 
nation. Implementation/utilization^ and building internal user 
system capabilities receive considerable attention in the new 
strategy. The federal role in^the KU-brieiited programs is seen 
as largely facilitating and coordinating, and much of the initi- 
ative in goal setting and probl^m/tlef inition is decetxtrallzed in 
the State and Local Education Agencies. Substantial sums are 
flowing to these State and Local Educatipn Agencies, and several 

of the programs suppolrt^d are oriented toward long-term capabil- 

(86) 

ity-building goals rather than short-term product ^development. 
A significant amotuit of emphasis in the NIE strategy has shifted 
from prodi^ct development anct product advocacy to change process 
advocacy and change process capability development. 

Still, the older bureaucratic ^lode of goal siting appears to ' 

have persisted in many of those NIE funding programs oriented 

more toward the KP than the KU 6nd of the KPU spectrum. The 

^ \ . % . ■ . 

locus of goal setting in research and R&D has remained largely 

, * ■' 

centralized in the hands of the* NIE staff and their advisers 
. » ■ * . . . ' 

from the field, with resultant continued dissatisfaction among 
the research *and R&D communities about existing gJals, priori- 
ties, policies, iind strategleis. A , number of initiatives have 
been taken to involve researchefs frbm a few research areas in 
the definition of rese^ch agendas foV .their fields; (e.g. : -/ 
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conferences sponsored by the Basic Studies and ''Basic Skills 

groups of NIB''**' But as yet, the research and RiD commu- 

nltles have not had anything like the lnf;Luence of researchers 

In some of the scientific disciplines • Increasingly, there 

have been ^alls for a strengthening of the research and R&D 

conmuhitiea and the development of mechanisms to permit the 

field to exercise leadership in^ defining goals and research 
(38) 

agendas. We may, then, in time see yet another metamorpho- 

sis of goal-setting and policy formation in educational R/D&I, 
with significant Implications for R/D&I priorities, strategies, 
and funding programs. ^ 



V . ADMINISTRATIVE PROCESSES 

As id typical of any nevly developing R/D&I system, concerns for manage- 
^nt and policy making processes have taken a low priority as compared to 
programmatic concerns. The dilemma is classical. Those who are most 
.likely to initiate an innovative thrust are leadt likely to see the need 
for or pay attention to effective perfotmance in the %undahe" Q^oblems 
of institutional management and the "dirty" problems of policy making. 
This has been the sittiation In educational R/D&I. Little attention was 
given in the past to such Issues at the practitioner level, and manage- 
ment for educational R/D&I was not seen as a major and necessary aspect 
of the agenda of federal funding programs • With increasing maturation , , 
again as is typical, concerns in these areas have begun to appear. Problems 
of organizational design, *|personAel management, project and portfolio 
selection, control and evaluation, cash flow managementT, infoi^tlon 
management, etc.»have begun to plague managers and 'policy makers. NIE 
has begun on a- modest scale to support some studies of management and 
policy making processes in R/D&I. The tim^ would thus seem ^Ipe for a 
major expansion in research and training programs devoted ^ upgrading 
the quality of management and policy making processes. 



In this report, we will limit our comments to the above brief overview. ^ 
In a later volume, we will provide a . detailed discussion of the adminis- 
tratlve processes function at the generic level. Analysis of the adminis- 
trative process ftinction within educational R/D&I per se, then, remains 
an item for analysis at some future time. 



■ • > J 

VI. PERSONNEL BASE ' \ 



1. A Critical Weafeiess 

The personnel base "(iff the education operating system In this country is 

(93) 

well over three mlll$on« However, relatively few of the Instructional 

:axid administrative p^sonnel.who staff this operating system carry out, 
sl^lflcant ll/D&I activity, and we will focus our attention here on the 
specialized e^ucatloiml R/D&I personnel base. » 

, % *■ I 

The spec lallzaB educa^onal R/D&I personnel base h£^s undergone substantial 

development in the^aja^jt decade or so. In comparison to the mid-' 60s , the 

educational R^^j^X pe^onhel base has doubled (perhaps tripled). The best 

estimate was that th^R/O^I system personnel base in 1964 totalled about 
' (19) 

4,000 persona.^ '^In ^74, several estimates' suggest a mean figure of 
about 10,000 persons (eirtimates ranged l^rom 8-12^000, and higher or lower 
estimates can be found ^ depending on onels definition of an educational 
R/D&I system).-^ • •■Still, the pers<mnel base of? educational R/D&I may be 
the most critical syJf^. we^kiiess ^and /the most difficult to overcome. 

The literature sugg^t^^-^fiat the educational. R/D^I personnel base is in- 

^ ^^C- (19 63 93) 

adequate lii/sheei^>tliSbers ; ' ' ^ is disptroportlonately concentrated 

in r^seat^i^iv;^^ research and development; ' la critically* 

spar s^xtn^i^^8piat ion; and almost tota|.ly abi^eift in functional speclal- 

B that are Just emerging or have yet to emerge (e.g.: need Iden^tlf Icatlon, 

acquisition, and* implementation/utilization support). The field suffers 

particularly from the lack of an adequate supply of trained or experienced 

R/D&I managers, or even an appreciation of R/D&I' management as a function 

that could benefit from specialized skills and training • , 

2. The Sources of Personnel , 



By ti^Alning ajid professional background, educational R/D&J personnel tend to 
come out qf either the psycho logy/ socio logy statistical research tradition and 
the university environment ^^^^ or out of, sehool system posltlpnl^ (e.g. ; teachers 
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or administrators). With few If any training programs geared to producing 
R/D&I specialists (and tl^e few that have been available geared more to the 
pattern of academic project research rather than prograipatlc development), 
on-the-job training has befen the' primary mechanism for producing personnel 
with appropriate skills and competencies — an Inefficient strategy at 
best. Some Initiatives have been taken to develop training programs more 
suitable to the needs of educational R/D&I functioning (e.g.: dissemination 
and utilization training progratas supported by NIE) . But as yet. It Is too 
early to detect a significant change In the character of the system's personnel 
base. 

3. Some Seemingly Intractable Problems' 

The •recruitment, training, and socialization of a talented personnel base for 
educational R/D&I will require oveircomlng several seemingly Intractable prob- 
lems; for example: ^ 



1* the low prestige of education, educational research, and 
educational R/D&I; 

2. the orientations Ibf most of those who come out of university 

settings toward advancing theory rather than improving practice; 
toward Individualistic rather than team functioning j-^ toward 
relatively homogeneous rather than heterogeneous personnel skill 
mixes; toward producing publications rather than products l>r 
programs; toward a professional rather than a bureaucratic style 
of 'functioning and management; 

♦ 

'3* the complexities of developing suitable training p^grams, given 

the ambiguity that surrounds the definition of work roles, requisite 
skills and standards for v^lous functional specialties in the field 
and the weakness of the existing knowledge base; ^ 

4. the instability of R/D&I funding; 

5. the insecurity of R/D&I positions compared to tenured university 
> posts • * 



4» Policy Issues 



There has been much criticism of educational r/D&I for Its failure to attract 
eminent researchers and first-rate youngVjr^'^alent from the disciplines. But Is 
it possible to attract talented personnel to educational R/D&I, gtven the present 
poor quality of system outputs and the resultant Inability to overcome the 
system's low prestige? Is It reasonable to try to Intervene now In the 
maturation of the system's personnel base? Or, Is It wiser to concentrate 
resources on a few key projects where the critical mass of talent already 
exists and impressive leVels^'of achievement are within reach? Will a few 
exciting high quality R/D&I outputs do more to attract talented personnel than 
resource-building strategies focused on recruitment and training? High level 
debate on these questions would seem to be In order,' leading, one would hope, 
to long-range planning of interrelated product development and resource- 
building strategies to speed system maturation. 

i' 

Our knowledge of other R/D&I systems .suggests that the rate at which the 
personnel base can be expanded varies among R/D&t' system functions. In 
research (and to a lesser extent, development), the rate is dependent on 
the niunber and size of the existing centers of excellence (whlcTi alone 
can provide the training) and is a long term process. For the linkage ^ 
functions (dissemination and to a lesser extent development) , training 
programs can be developed at relatively modest levels of funding and 
personnel trained within a relatively short time frame. However, training 
in. these functions will be constrained by (1) rates and levels at which 
users can reasonably absorb their outputs and (2) the relative lack of 
codification in the knowledge/technology bases. Thus, merely investing 
dollars in training is not always wise or (effective. ^ 



VII. FUNDING 



The funding of educational R/D&I suffers from five key weaknesses: in- 
sufficient dlverslf lcatl6n of sources, low levels, scattering of alio- 
catlcfns, instab^lty, anS Inadequate , data base about distribution of fund- 
ing by functions and performer organizations. 
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1* Insufficient Diversification of Sources 



The federal government has become the primary sponsor of educational R/D&I. 

A small -portion of overall R/D&I funding Is provided by private foundati.ons 

and an Infinitesimal amount Is provided by state and local governments and 

private Industry. Several analyses of fundlr^ data are currently under 

way, and the precise figures may need revl8lc|h when these are completed. 

However, jEor the present, we can arrlve'at a reasonably good picture of 

the level and sources of educational R/D(I funding from the best analyses 

available to us at this time. According to those sources. In FY 1975, 

total funding for educational R/D&I In this country,' TErom all sources, 

fell somewhere between $605 million and $673 million (depending on what 

is Included or excluded in a given estimate) , with $619 million the most 

likely figure. Of this total . sum, approximately 83%, i.e. , $513 million, 

came f rom /etfcb^al govemmen£ departments fir agencies. ^^^^^ The bulk of 

this funding is provided by the E^ucatlo^ IJivlsion of HEW, with most HEW 

funds obligated through the Office of. Education and* the National Institute 

of Education. Other i^ederal agencies providing substantial sums for 

educational R/D&I Include the National Science Foundation and the Public 

Health ^rvlce (particularly the National Institutes of Health and the 

Office of Human Development). Additional smaller pinns flow to educational 

R/D&I •activities through the Department of Agrlcuitujre, Department of 

Defense, Department of Interioi;, State Department, Department of Labor ^ 

National Endowment for the Humafiitles, Smithsonian Institution, and other 
• (102) 

federal agencies.'' ' The remaining sources of educational R/D&I funding 
include: state funds, $40 million ($30 million to $60 million); local 
government funds, $4 million ($2 million to $10 million); - private founda- 
tions/ ,$57 million ($57 million to $65 million); iid other private sector 

sources, possibly (but here estimation is especially difficult) . $5 million 

(93) ' 

($3 million to $25 million).- ^ Greater diversification of sponsorship 
seems, esser^al clven, ^le political vulnerability of educational R/D&I 
(and* thus Its^^^^lng) in a climate of limited system legitimacy and 
lack of conf^W^% the system's ability to produce a reasonable return 
on the taxpayer's itlt^estment . Clearly, though, substantial Investment 
in educational R/D&I by/ the' private sector or by state and local govern-, 
ments is unlikely unless imaginative new incentives *are provided and bold 
new initiatives are taken to attract this new sponsorship. 

38 ' 
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Educational axpanditures by all levels of government amount to approximately 

r $55 ^billlon.^' ApproprlatioDfi to educational R/D&I account for only about 0.3Z 
(72 103) 

of that total. ' , The Inadequacy of this funding level is underscored by 

comparison with other sectors — e.g.: - 3*4% to 5.0Z of expenditures in the 

industrial sector for R&D; 4r.6Z in the health sector; I.IZ in agriculture; 

(23 49 72 103) 

and a& much as 10% to 14% of the Department of Defense budget. ' * ' * 
Given the Immaturity of educational R/D&l compared to these other sectors and 
the need^ for expensive capacity-building programs, the low level of funding 
available to support educational R/D&l becomes especJi^lly problematic. 

3. Scattering of Allocations 

The difficulties posed by lov overall fundjjig levels are complicated further 
by allocation patterns that tend to disperse what little money is available 
over a large number of projects rather than concentrating it sufficiently 
on a few.. The trend in recent years has been toward greater and greater 
concentration of funding, as m6re and more projects and programs have lost 
funding and increasing numbers of federally suppoi^ted R/D^I institutions 
have gone out of existence. Still, given'^e limited funding available 
and the high costs incurred by l^rge-scale educational R/D&I programs, 
greater concentration would seem essential if effective programs and products 
are to be produced. r- 

4. Instability 

Instability of funding has been one of the most serious problems confronted 
by the educational R/D&I system over its brief history. The early promise 
-of ample funding for educational R/D&I was clouded within only a few years. 
Funding for different types of R/D&I activities has tended to ebb and flow 
with frequent shifts and fluctuations in federal R/D&I priorities. Federal 
reliance on annual rather than longer-term funding cycles was a frequent 
cause of complaint in the early years of the system. While all federally 
funded sectors suffer to some extent from srfch instability, the problem 
has been especially critical in the eduction sector because of its relative 
immaturity. 
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Pleas ^hAV6 been nuida for longer-term funding consnltments to permit long-range 
planning of complex multi-year projects, and some modifications of funding 
policies in this direction are apparent. Still, it would seem that greater 
long-term stability of funding will be needed to attract first-rate 
personnel and sub-contifactors to educ^lrfon^ R/D&I. 

» 

5, Inadequate Data Base About Distribution of Funding by Functions and 
Pferformer Organizations 

■J., . 

Kb we noted just above, a^irailable data do suggest that scattering of 
allocations is one of the weaknessea of educational R/D&I. As yet, our 
data base is inadequate to systematically analyze this distribution of 
allocations. However, NIE is currently doing a survey of educational 
R/D&I performer organizations. When this is completed, we will be in a 
better position than now to csstimate the relative size of actual funding 
allocations by functional areas of R/D&I activity. Thus, we will also 
be In a better position to determine the. extent to which the available 
res^iirces are apportioned in a manner that provides the appropriate 
balance V^^ng functions (taking into account the overall stage of develop- 
ment of the R/D&I system and any necessary corrective actions that may ^ 
be needed to redress previously outrofnbalance conditions). 



Various data sources available at this time (using somewhat different 

definitions and classification schemes) provide rather disparate estimates 

of the distribution of federal funding for educational R/D&I among groupings 

of functional areas. For Instance, a recent delcription of one data set 

for FY 1975 projects in the areas of early childhood and adolescence 

suggests that 80Z of this funding was allocated to a category described as 

applied R&D; 8% to basic research; and 12Z, to a group described as 

(93) 

planning, dissemination, utilization, and evaluation.. Another data 

Bet (using a dif'ferently bounded data base and a different classification 
scheml^ provides a different imprearsion of the distribution of federal 
funding for educational R/D&I in FY 1975. These data suggest that knowledge 
production activities (defined here to incl.ude- research, evaluation, and 
statistical activities) have received only 17% of federal funds, while AOZ 
was allocated to a* category described as applications formulations (materials 



development 9 pjplicy f ortaurationv deinonstratlons, and social experiments) y 
and 43% tj"utlll2atlon (dissemination and Implementation activities) . ^"^^^ 
Still other even more recent reanalyses of these same data oy^NIE's R&D 
System Support Division staf;g suggest slightly different figures, and 

these reanalyses are still in progress. Data from the current^ NIE survey 

. ' • . ** • ' ^ 

of educational R/D&I performer organizations may be helpful in*^larifying 
.some of the inconsistencies.^ - ^ 

''^ . .'"'^ • 

The current survey may be particularly useful also for shedding light on 4 

questions that have arisen about the relative distribution of V funding (from 

f^eral and other sources) among the various organizations that comprise 

the institutional base of the educational R/D&I system. NIE funding data, 

for instance, indicate that5rmore than half of all NIE awards between FY 1973 

V (93) 

and FY 1975 were made to fewer than 50 organizations. It would be 

useful to have similar information about awards from other sponsors of 
educational R/D&I activity and to then explore; the meaning and implications 
of such data for understanding the institutional configuration of the 
systiem; the location and degree of concentration of certain kinds of 
R/D&I functioning; the distribution of., R/DSI capabilities (and implications 
for system capacity building) ; sponsor-performer relationships within the 
educatioi^l R/D&I syst^ (and^implications for funding/procurement policies); 
etc. " - \ 

• ■ * ' 1 * *' ■ ■ . a 

A substantial data base is currently -being developed and analyzed to shed 
light on such questions, and additional studies under NIE's Education KPU 
Monitoring Program are in planning. As more of this Information becomes 
available, we will be able to devel9p a more compiel:e picture and a better 
understanding of the funding of educational R/D&I. 



VIII . INFOR>tATION FLOW / 



There 'are three distinct information flow systems in the education sector: 

I, KP information flows among educational researchers and R&D \^ 

' personnei generally working in organizational settings external 
*to the user system; ^ ' 



2. information flows, among user systenl personnel; 

3. information flows between extenal research and R&D pe^rsonnel, 

on the. one hand, and user sysMm personnel, onVhe other. 

- ^ I • ■ . . • ■ 

All three Information flows are weak and ijaefflclent . Each has distinctive 
problems that Impede effective communication and information floW and therefore 
slow: ... 

1. the cttemlat^e development of a high quality knowledge and tech- 
nology base for the field; fe^-v 

■ • . : ' . . ■ 

2. the development and dissemination of research and R&D outputs to 
solve educational problems; 

3. the utilization of research findings and R&D outputs in operating 
systems. , - 

1.. Among Educational Researchers and R/D&I Personnel 

. ■' ' ' ■ . ' ■ ■■ . 

The educational^ research community has 'a well developed formal information 
flow system that^ncludes annual meetings of the AERA; primary publication 
outlets; and secondary publications that provide syntheses and' critical reviews 
of the literature and :that provide mechanisms which facilitate information re- 
trieval from written sources. However, scientific information exchange in 

education is more unstructured, random, and far JLess efficient than information 

(96 97 98' - 99 ' 101) 
flow in many other fields. * t * * The educational research and 

. # • * • J * 

""R&D communities lack well developed informal communication mechanisms analogous 

to the "invisible colleges" that' have been identified in some other fields of 
knowledge'. <32, ^33, 111) 

Informal communication networks are critical in order for a researcher in a 
given research area to be familiar with work being done by others that would 

be potentially relevaii^t to his own investigations. Informal networks are also 

critlcral to permit researchers to*contact olfHer researchers who can facilitate 

their information searches and minimize random information-seeking behavior. 



Further, ,the absence of such informal oommunication networks to structure * ' 
and chaxmel Information seeking behavior magnifies whatever time lags 9 lack 
of adbequate atfstracting and retrieval mechanisms, and other problems 
characterize the formal, information flow system of the field. ,100, 101) 
Thus, the absence of informal networks handicaps the educational researcher. 

The development of a cumulative,' high quality knowledge base for the^field 
is dependent on improving .the ^efficiency of information flow processes — 
but there are few signs of progress in this direction, 
^ ♦ 

2. Within the User System 

■ ■ - • V 

o . ■ 

' , ■ ■ . . f 

Information flow within the user system is generally retarded by variot;s norms 

and patterns of functioning that t;end to isolate operating system personnel ' 

from one another: e.g.: antlcollaborative norms that assume the creative 

teacher generates, ideas and teaching approaches on her own rather than 

using ideas axid Approaches developed by others; timidity about discussing 

classroom problems for feat of being judged inadequate; bureaucratic rather than 

colleagial modes of functioning that isolate the teacher Xji a :<:lassroom full 

^ f, ' ' ' ' ' ' 

of children and provide few opportunities for teachers to stimulate 

u u \. " ^ (26, 27, 119, 125) „ , ' ' u ^ 

one another, exchange ideas, etc. ' ^ Research suggests that most 

teachers do not scan t:he professional literature in searrch of ideas or solutions 

to problems, but instead rely on interpersonal exchanges as their main source 

of information. ^ Given the fact that there are relatively few opportunities 

for such interpersonal exchanges in mo^t school settings, information flow is 

therefore minimal. . . , v - 

3. jfetween User System and Research/R&D Personnel . , ' * ' 

Informatior^^ow between user system personnel and research and R&D personnel 
in KP organizations external to usqr systems is hampered by even more serious 
problems — differences in values; norm3^ ways of thinking and 
conceptualizing problems; wdys of describing and bases for verifying 
assertions; usag6 patterns; little if any overlap in the journals or 
magazine^s they read (or publish in) or the professional association meetings 
or conferences they attend; etc. 
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4. Trends and Inltlafcives 

Some progress is being made currently to overcome the barriers to information 
fl_ow within the user system and between user systems and external KP 
organizations. One importan^initiative is represented by NIE support for 
prograrSs to develop internal •^problem-solving capabilitj^es through organizational 
development and other participativje renewal strategies (e.g.: the Local Problem 
Solving Program). /Xnother is represented by NIE' s active, interpersonal^dis- 
semination and technical assistance strategies to facilitate KPU infpnflation 
flows (e.g.: the Education^Informat ion ^Centers and the R&!d. Utilization Program) • 

However^ despite AERA interest a few years ago in fetrengthening research 

communities and developing more effective communication mechanisms analogous 

(38) 

- to invisible colleges,^ ' the Association has done relatively little to structure 
information fl ow in the field into more, orderly patterns. There has been a. 
vacuum of leadership in this criticffT^areaj and in t^e absence of. any 
initiatives to improve information rlow amdhg education researchers, the ; 
knowledge base of the field remains weak and fragmentary arid R/D6cI functioning 

^^emains inefficient and relatively ineffective. 



IX. INNOVATIONS 



1. Widely Varying Attribute's and KP/KU Rec|uirem6nts 

Edi^cational prcJducts and innovations vary widely in attributes and attendant 
KP and KU requirements. They vary in the state of the art of the relevant 
technologies; scale, costs, arid level^of R&D effort requir^ed; in type' 
(categorized as hdrdWare vs. software); in target fujcict ions; in demand levels 
and life cycles; in quality and relative advantage over competing products 
and practices; in testability and communicability of effects; in complexity; 
in compatibility with user system constraints and therefore^ user requirements. 

Given this variability, any attempt to provide a modal description of • 
educational products s^nd innovations seems risky. However, to facilitate 
comparison with other sectors in our analysis, it seems useful to consider 
a number, of generalizations about educational innovations that are probably 
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valid for the overwhelming majority of products and innovations in this 
sector. , We have noted ^some of tihese points earlier in our discussion of why 
the educifitlon set:tor is so vulnerable to environmental influences. 

2. High Development Costs 

•. • V : 

Educational products and innovations that are rigorously developed and tested 
tend to have relatively high developmental costs. This is attributable to 
a large extent to the weaknesses of the existing knowledge ba^e of^thfe field 
and the resultant need for conducting an extensive amount of applied research 
preceding and during the developqaent phase, ; Gaps in the knowledge base of 
the field entail more unknowns'. Weaknesses in the relevant technologies entail 
more trial and error, , The transforms between stages (from concept-ion; ^ 
to specification of design requirements; to prototype 'development ; to 
development of successively refined versions of the^ final'>roduct) are less 
efficient, less predictable, more time-consuming, and more costly^; - . 

3, Product /User Reactiveness 

Educational^ innovations tend to involve "people change" rather than installation 
of technology. As such, educational innovations are harder to packag 

'more difficult to market and get adopted, and harder to install. There is far 
greater reactiveness between product and users, and therefore the implementation 

' prCcess is more difficult and more implementation supports are needed. Product 
ahd itjnovation management strategies fAr the education sector, then, if they 
are to- be effective, must take into account product" attributes that are likely 
to affect user system willingness to adopt and capability to implement a given, 
innovation. At the present time, however , integration of KU requirements into 
KP planning and activities appears to be the exception rather than, the rule^.^ 

>As a consequence, externally develpped R&D outputs have not been^iffu^^l?-iridely 
or had notable impact on educational practice. ' :^ 



X. NEED IDENTIFICATION ' 

Overall, need identification in education lacks coherence and strength, 

f ■ 
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1, packing; An Institutionalized' Need Ide] 



Need identification is one of the^functional specialities of mature R/D&I 
systems that is generally lacking 'in education. There are relatively few^ 
examples in the education sector of systematic, ongoing analyses of routinely 
collected data, cyclically reviewed part of an institutionalized*^ nee 
l<ientificat ion function focused on needs assessment, xapabilities assessment, 
and long range planning. Instead, whether we examine the process by xvrhich 
needed R/D6el activities are defined by KP institutions' or the process bV 
which needed 5^ acquisitions are identified by KU institutions, need 
identification in education tends to be episodic (or, at best, attuned to 
the annual funding or budget cycles of R/D&I sensors). 



/:^^^M;fJn/further^ contrast to maturetR/D6eI systems (where need identification processes 

•x^ '^^^^e . institutionalized in specialized organizational arrangements) , the loci of 

■•■ 'J ' " ' .' o ■ ' ■' 

need icfehtlf icati«a 

and operating systems and their environment researchers, developers, R&D 
entrepreneurs, R/D&I sponsors, and R/D&I institutibns; policymkkers and 
administrators at the federal, state, and local level of the operating system; 
teachers ai>d other operating system personnel who interact directly with 
students; school boards and their parent and community constituencies; and 
perhaps mos^ promineht of all, the Congress, the courts, and various social 
movements such as civil rights, ethnic pride, feminism, etc. . j 




Need identification in education, then, lacks formalization, and its openness 
to environmental influence is so great. that \the system lacks adequate buffers 
against extremely high levels of demands too varied to be met adequately. 



2m Bases 



Several bases of need identification are operative in educatioii. 

' '■ - ^ n ' 

A.> Intuitive Judgment * * 

Intuitive judgment is the basis o£ x^at is probably the largesV proportion 
of all need identification in the sector. There are several patterns of 
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Intuitive need identification in education: spontaneous insight; soli-"^ 
citation of staff or expert opinionis; comparing what exists at a particular 
point' in time in the programning of a particular. R/b&I or operating system 
institution and \diat exists somex^ere else, [ * ' \ / 

B, Opportunistic . * * 

An^ additional pattern of need identification in education is basically 
opportunistic in nature the impetus come§ primarily from the exist- 

ence of a resource and or^l^ secondarily If all from the existence of 
a problem. The availability of a resource ' (e.g. : funding 6r av new. tech- . 
nology or an available talent pool) and its jpbtentlal f or ji^e in a bene- 
ficl^l manner are what in fact syggests the need. * 

C. Data - Based > , ! r , e 



Probably the least frequent basis of need perception in education is em- 



pirical data. Two kinds of data-based need identification can be distin- 
guishe4: one-time analyses of particular pieces or bodies of data, col- 
lected primarily for some other purpose but^. used... pA- fl^a ad^;hoc basis to. 
identify a particular need or set 'of needs; 'and systennatrc, ongoing arialyses 
of routinely collected data cyclically reviewed as part: ofi; an institutional- 
ized need identification and long rahgeir planning Sanction . T 



3. Vaugeness of iflequi: 


4 " 
rements 









The processyof translatirCg perceived needs into innovati^ requirements specific 
enough to guide research and dev^lppmentj^ is barely evident in education. More 
often than not, the need identification i)rbcess ends with a statement no more 
specific than "a program to improve students' self -.concepts" or "a program 
to raise reading achievementf levels'^' . Rarely doe^ : t:he>need identification 
process in education produce a problem analysis sufficiently detailed to ' 
pinpoint either specific elements in fchfe p'toblernatdc situation (or condition 
in need of change) or t;he kind of progrfuir oYi product necessary to bring , 
about desired thanges. . ' ^ ' ■ " ' - 
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Given the social science base, of the field of education,^ there is a somewhat 
limited intellectual consensus on the one hand and a good deal of value-laden > 
disagreement over goals and needs on the other. This puts, a premium on 
vagueness ; — i.ie.: the vaguer the statement of a need, the easier it is to 
achieve agreement. Needless to say thisj complicates the problem of 
articulating needs in a manner t£at-4;r^slates easily into innovation 
requirements* 

Equally significant in its impact on needs articulation, education has an 
inadequate and uncertain knowledge base and an ambiguous technology. It is 
difficult to define problems or to know what is needed to solve them. 
Consequently, people have a difficult tijne identifying and articulating needs; . 
thus, people als'o tend to generate statements that are too vague to be 
genuinel.y useful. In those atypicial settings where an extensive amount of 
need articulation occurs, therq are specialized organizational'^rraugements 
to translate vague perceptions of need into innovation requirements - (e.g.: 
R/D6el organizations that use evaluative data on existing products as the basis 
of defining needs and planning R6eD for future products; or R/D6el sponsors who 
elaborate R&D contract requirements through mechanisms like the RFP) . • 

4. Decision Structures ' \ ' 

Probably the greatest weakness of the need identification function in education 
is in the decision structures through which need <statements are scref^ed and 
appraised before R/D&I resources are committed. Lacking is an adequate data 
base against whichJ:d-^Ttdge the feasibility of responding to various alternatives 
identified as nefeds for R/D6el activities — feasibility in terms of the existing 
knowledge base; capabilities for meet irig various needs; and marketabilkty of 
various kinds of products *to meet given needs. Lacking too are adequa^ mechanisms 
for bringing together the perspectives of both the KP and the KU^endsVpf the 
KPU system in education to jointly define needs and priorities. and jointly 
consider existing capabilities to meet a given ^ed by new R/D&I activities 
(or alternatively^ to adopt or adapt existing products or programs from 
the full array\ok available practices, programs, and products capable of 
meeting that neeiii . ' ' ^ - : 



Recent Initiatives 



Recent NIE initiatives have been directed toward strengjihenang need identif i- 
cation processes. The dissemination and localyproblem-solying progr^s of the 
Institute are basically capabil^Jfe^^^uildihg programs: the intent £s to 
build local capabilities for problem def inition land to link user system 
personnel to KP resources that can be applied ^t^ solving/ locally defined - 
problems. Similarly, NIE^s increasing use of i]|vitatioiial conferences to 
define research agendas arid needed R/D&I activities has been motivated by 
the desire to brii^g the research communities fr^m;- (education and ^^ ^he^isc iplines 
into the need identification process ^th maxin^ltef f icienty — getting 
simultaneous input and feedback from the leaders of a given research area, 
and at the same time developing some consensus on priorities and disseminating 

these to the field (e.g.: » conferences sponsored by NIE' s Basic Studies and 

(132) ' 
Basic Skills groups). However, as yet, there is only limited evidence of 

overlap between the highest priority needs "identified or acknowledged by 

practitioners and those identified and acted upon by extemal^esearch and 

R&D organizations. Consequently, need identification at the.4i^ and KU ends 



of the educational KPU system show limited j^e^^ation^ and the effectiveness 
of R/D&I functioning throughout the system /limited accordingly. 

A hopeful sign is fehe substantial amount of Ijeffprt currently going into the 
; development and use of ongoing management ii|'f6riEiation, monitoring, and assess- 
ment systems on the state and national (and to a lesser extent even LEA) 
levels. ^^^^ It is still too darly to expect to find sig- 

nificant impact from these new developments ~ ^xxt clearly ,'*as assessment 
systems and long range planning units get better^ established in the education 
sector^ we should look for evidence of major chatiges in thfe manifestation of 
the need identification f unction^ in education! 



XI. GENERATION /RESEARCH ^ . 

^ ~ ^ ■ 3 ^ 

... 1 . * 

1. The Focus of this Discassion ^ 

The term ''research** may have a variety of cbnnotations and meanings — and is 
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often used very loogely in the education sector. Thus/it is important that we 
first identify what "types" of "research" will be the focus of this discussion. 



A. "Discipll'^d Inquiry" 

/ In this discussion, we shall be concerned only with "Research" in the sense 

' • • 

of "disciplined inquiry" — the conduct of systematic empirical investi- 
gations or the application of disciplined qualitatifVe inquiry approaches 
(e.g.: historical, anthropological and political science modes of 
investigation) to education-related questions. ^.Who conducts the disciplined 
inquiry isrTi^t at issue hei'e — the researchers may be those who identify 
themselves as \du^tional researchers or as researchers working within a 
particular dis^ttine. Within this framework, we thus include both 
basic (or "pure") research and applied research (i/.e. : research oriented 
toward either product development or; toward institutional and policy 
research concerns) . . 

We recognize the limitations of the "pure vs. applied" usage. Still^^e^itid 
it helpful, to think about educational research in' terms of three 
categories: \>^'" ^ 

1 - ' 

1. ba^ic research; 

2. applied research . /• 

3. applied research to inform policy decisions. 

We also recognize the somewhat arbitrary nature Of our division between 
the forms of institutional and policy research that we will include here 
and others that we will categorize later under the concept of evaiuation 
research. *^ v 
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* A (115) ^ ^ 

In another analysis we used the descriptive term "problem-focused 

research" rather than the more common temn "applied research" to highlight 
the difference in focus between basic and appliec^ research. Here, how- 
ever, we will use the term "applied research" because of its common usage. 



.••/•■■ 

Finally, we do consider (hat, properly conceived and done (i.e.: as - 
''disciplined Inquiry"),' evaluation is a form of research. Thus, we use 
the term "evaluat^ rather than "evaluation". However, 

because of its special nature and its usage at the utilization end of 
the R/D&I process, we treat evaluation research as a separate feature 
later. ^ 

B. Non-Systematic "Research" 

We specifically exclude from our discussion of the research enterprise 
various quasi-research activities that are typically labelled as 
educational Research and divert a fair amoun^ Of research funding away 
from disciplined inquiry, but use methods and serve purposes rather 
different from those of isystematic research e.g: : school surveys. 

Statistical surveys of the social bookkeep4.ng variety, socJUl action ^ > 
jpi;a^^^ and demonstration projects, and development, 

work. 

C. The Focus of This Discussion 

Research is only one of several bases of innovation and product development 
in the education sector. Fiew of the dominant educational practices in scho 
are based on research findings. Insight, ^ inspiration, jand analysis of a 
relatively unsystematic sort are the bases of much conventional/educational 
practice. Where infprmation is sought to guide translation of ideas into 
practices or mater iii^:, informal interpersonal communication or more 
formalized library research approaches are considerably more common search . 
strategies of the operating system than the conduct of systematic empirical 
investigations or application of disciplined qualitative ^inquiry approaches 
We know relatively little about these nonscientif ic approaches to the 

generation/research functlon' inv education, though ^thi^ situation ilay 
change# as increasingly more attention is devoted to documentation and 
analysis of local problem-solving strategies in the operating system 
(work currently in progress by the Center for New Schools, supported 
by NIE). 



We know considerably more abou^ the, conApt^ pf^ disc ipVLAed Inquity in the 
education sector, and it is this dlaip^yp^llped itiqulty that/ lias been the 



focus of R/D&I policy concexm* ^ ' ) . ^ ^ 

2« Issues and Proble ms of Ectefgaftjo^aX -Research 

— . , ' 

The educational^ imearch enterprise faces many of '^he same dilemma^ as research 

^in other fields J especially other applied social science fields. There are the 

universal Issues] of quality control of particular Importance in - 

education, yAxerii evaluati^ons consistently show poor definition of educational 

. research questions; Inadequate "methodological rigor; Inadequate grounding 

in theory; and'|ow ratings of the quality of mos^: educational research 
(113 14D 142 144) 

outputs./^ * * • *There is also the omnipresent issue of appj^opriate 

methodology — debated in education in terms of the strengths and weaknesses 

of experimental (or quasi-experimental) vs. the less control].ed designs in 

^ ^ (10 53 13'5y 

,the f ieCd settings in which most educational research is conducted. ^ » • 

A related ^^wBjMWff " inappropriate application of various statistical 
^^^t^hniques ii^^^^^^aalysis. / 

Several of the generic research issues that cut across all social science fields 
(and perhaps other sectors as well) are particularly pronounced in education 
because of the nature of the field's knowledge base, the nature of the demands 
made on the educational research community by external environmental forces, 
^ and the deep strains in relationships between researchers apd practitioners. 
Instances of these generic issues that take on particular salience in education 
are:, how to prodqce^ :.nterdisciplinary cooperation; how to determine Apriorities 
between basic and applied research; and how to protect subjects and operational 

settings from unwarranted interference by researchers. 

» ■ ■. •» 

A. How to Produce Interdisciplinary Cooperation 




Education is a conjunctive domain of knowledge — i.e^. : a field that 

£QcaSjes the perspectives of several diic iplines on understandiag and 

^^^^ (133V 
solving certain social problems. Since as many as twelve (or more) 

disciplines converge on inquiry, in education, interdisciplinary cooperation 

and cooperation between educational rese^chers and researchers in the 
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other disciplines become all the more Important 
to attain* 



but no less easy 



B, How to petermine Priorities Between Basic and Applied Research ^ 

The debate between b^sic and applied- researchers in education is phrased 
in tenns of the weaknesses of the field's knowledge base (how little or 
how much we know at this time to guide program or product development) vs. 
the immediacy of the problems in need of solution. Thus arguments can be 
made in support of basic research at the expense of applied research — 
for example: the contention that R&D programs at this time are premature 
and ill-conceived because the basic knjowledge bape is inadequate; the 
argument that applied work is ineffective in solving problems because rt 
is framed in terms of existing conceptions that are inadequate and will \ 
remain so until basic research produces major breakthroughs that affect \ 
the way we think about problems as well as the knowledge and -technology we' 
apply to them. Hoi^rever, other persuasive arguments can also be made for 
applied research at the expense of basic research — for example: the 
argument t'hat weValready know a great deal that is useful for solving ^ 
pressing problems that cannot await maturation of the field's basic 
knowledge base; or that effective solutions can be developed if the 
available knowledge base is effectively transformed and structured in 
a manner that facilitates application. 

Work now in progress will soon provide us with a better picture of how 
much support comes from which federal agencies (and other sources) for 
basic and applied research (e.g.: analyses currently being conducted 
by staff members of NIE's R&D System Support Division) and will place 
us in a better position to make judgments of th|Cfadequacy of the level 
of funding for system development. Numerous criticisms have been made 
of basic research funding in particular —that it has been relatively 
small in scale (and overwhelmed by proposals relative to available 
funds); has not been designed in accord with any overall basic research 
strategy; and has lacked either continuity or high visibility. 

There were many high hopes for NIE in connection with basic research in the 
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months prior to its creation — buC NIE has not become the think tank of 
eminent scholars that NIE proponents envisioned and argued for. ^nstead, 
fimding problems have. forced cutbacks in the small basic studies unit within 
NIE; allocations for basic research grants have remained relatively small; 
'and earlier Initiatives to strengthen basic research (e.g.: the four-year 
funding of COBRE, the Committee on Basic Research in Education) have not 
been continued. 



The COBRE project was of particular importance . it had an eminent orgaaiza- 
tionki^set ting (the National Acadeiay of)Education and the National Academy 
of Sciences - National Research Council). Eminent scholars serveff on the 
Committee. Its task was "to Identify problems to be attacked by basic 
research in education and to ^develop and try out plans and procedures for 
stimulating aiid supporting such research." it had moderate success In ^ 
attracting both established and younger scholars from the social sciences ^ 
to basic research In education. -Still, it was discontinued. . 

C. Ethical Issues . " ^ 

Ethical issues surrounding relationships between researchers and human 
subjects take on added meaning in education wher,e the human subjects' 
are often children and where relationships between researchers and 
practitioners are often strained. In educational research settings, the 
need to protect subjects from harmful effects of experimental treatments 
or from invasion of their privacy is a very important issue. These 
direct ethical Issues raise** further issues about the amount of control 
^ researcher can have over the conduct of his own inquiry — e.g.: the 
role of, the practitioner in defining the problem to be investigated; the 
amount of manipulation of "treatments" to be permitted in an operational 
field setting; the n^eds ybf researchers for a stable program stimulus 
vs. thp needs of program Personnel to keep changing their program in 
terms of changing needs and understandings of what they are doing. 

3. The Changing Character of the Educational Research Community 

■ . 

A. Initially; A University Base 

In addition to these various research issues, there are a host of new 
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Issues that; have emerged out of the changing chllpEicter of the educational 
research enterprise. Until the mid-'605v educatdonal research was an 
activity carried out by a relatively ^mall number of individual researchers 
who were based in" the universities; -^perated with a great deal of autonomy 
in defining problems and conducting ilcivestigations; devoted a small 
proportion of theij time to -research; were oriented primarily to , > 

publishing research findings- that might add to our understanding and 
knowledge about: educational phenomena; and were regulated primarily 
by a peer gi4)up review system that allocated rewards primarily in the 
form of prestige and recognition within the scientific community. 



B. New Institutional Arrangements 



Developments of tl^e^ast decade and a half, have transformed educational 
research, ifiie educational research coracaunity has grown rapidly in numbers 
and in- 41versiffied institutional 'bases. ^ * ■ Although. almost all basic 
reseairch ia still carried out in thq universities and some applied work 
is done there as well, non-profit and for-profit research corporations 

have emeirged as a strong competitive force in sepuring applied research 

(1 83 93) ' 
contracts from '*^yermentalagen^ * / Consequently, more and 

more of this research is being done outside the universities, with serious 
consequences for tesearch training; for. information flow and the cumu- 
lative development of the field's knowledge and technology base; and 
for the jnanner, in. which (and Nthe extent toyhich) research findings get 
tok, "be disseminated and utilized. . The new institutional arrangements for 
the cdnduci; of research ''have ^ tmncied research into a full-time pursuit for_^ 
a large portion of the research communit^r. Of even greater consequence, 
these new arrangements have had a significant impact on the nature of 
feducatlonal reseSrch and the educational, research community. ^ These new 
arrangements have produced new patteirns of research functioning (e.g.: 

rese'arch teams rather than?ind±vidual researchers). There are new modes 

^ ' ' ' . - .. . ' ■ 

of research management arid new constraints on researcher^ — i.e.: 

bureaubratic, mission-oriented research management that limits the 

individual researcher's autonomy in both defining research problems and 

conducting 'inquiries. ^^^^ There are new research subcultures with wholly 

.new systems of rewards and control^that weaken the impact of the disci- 



pUnes on the conduct of inquiry — e.g.:* political and bureaucratic 
norme are competing with and (for many) rigplacihg professional norms ; 
political influence and economic incentives are replacing scientific 
recognition as rewards; and agency acceptance and utilization of research 
f indixigs are replacing peer review ot^ientif ic quality as the dominant 
.^controls.^ ^ 




C. New Kinds of Accountability Issues » ^ 

• The new prominence of educational research, and 'the amount of , public funds 
flowing to it, have JHi^ed new kinds of accountability Issues that may be 
harder for researchers in Che education sector to resolve than researchers 
in other" sectors which have strcmgef knowledge and technology bases. The 
Congress has bee/ demanding public, accountability for an inttnediate payoff from 
its inyestmeijtr in educational research' without any realistic apprecia- 

tion /o^^Ke extended time frame needed to produce reistilts^in research in 
genextal and in educational research in particmjiar. . Thus, ve find a 
"Catck:- 22'' type of situation. On the one hand, to obtain, funding, 
researche^rs must provide some promise of a payoff regardless of the . 
fact that research.by definition involves a ndt insignificant degree of 
uncertainty. On the other hand, to make promises which cannot be fulfilled 
/ may |;esult in the researcher being funded — but even more importantly, 
such unfulfilled promises lead inevitably to public disillusionment and 
a worsening of the political environment of the researdh enterpri^^a^ The 
proper stance for educational researchers to'^take in relation to government 
agencies, and the kinds of research outputs they should provide (i.e.: 
solutions, ^approaches to defining problems and thinking about solutions, 
or information about the likely or o^^^a^ed effects of alternative solutions 

under consideration by policymakers) < — these are matters of seriidjus debate 

(22 >79 llOV 

r among educational researchers and social scient;||^ts in general. ^'^f * ^ 

.- — .4 

4. The Future 

Despite frequent calls in recent years for a strengthening of the educational 

research community and more field-based initiatives to structure the national 

(38) ^ 

research agenda for education, the educational research community remains 

■ 7 . . • - • 



diffuse tpolitlcally weak, and largely "reactive to fedetal initiatitves designed 

* . . ' ■' ' 

by government bureaucrats who are generally not members of the research com- 

' . * ■• ■ I 

munity. We see relatively little evidence that this situation will change in 

the near future — certainly hot without NIE support and initiatives. 

The strengthening <of the 'educational research community in the future may 
well depend oct collaboration among the leadership of the research community 
and tl^ key federal agencies and other major sponsors of educational research, 
with initiative perhaps remaining still with the federal agencies. OuiT 
analysis of what is needed is based on consideration of the sonfewhat distinc- 
tive requirements of ' basic and applied research and ^the current state of • , 
development of the institutional and personnel bases for conduction of the 
baaic and applied research functions. 

In thinking about the future of educational research, we will^ neei to review^, 
our understanding ^ the'basis upon which it .may be assessed and . of its cti^rrent 
status. From these we may suggest key needs for the future development of the: 
educational research function. Ue will do this separately for basic and 

■ ■■ 

applied research. . ^ ^ 

A, Basic Research ^ 

Assessment Basis , 

In assessing basic research for education. It is important to recall, the 
interdisciplinary nature of educational research. ^ On the one hand,, we 
said that there is basic research being performed in several disciplines 
(e.g.: psychology, sociology) which will be relevant , to education. 
However, education is a subsidiary concern of these other disciplines. On 
the other hand, consideration has also been given to, basic research which 
is done within the field of education per se and which la performed by ^ 
researchers trained in and committed primarily to education as a field- 
of study. It^ is this latter ^focus which Is our primary concern here 
because of the importance of having a basic research function whose 
primary^ and ongoing focus and commitment is on the field of education per 
sie -r while at the same tli|ie recognizing and utilizing Important and 
relevant basic research in other fields. - 



As basic research Is an uncertain, unpredictable and highly creative uncer 
t^ing, it is very sensitive to threats to its climate and to the quality 
and stability of support and funding and is highly dependent on its roots 
in its fundamental disciplines • Its outputs are knowledge and stimulation 
and^^t^s only generally in the long term that we can assess its practical 
ccmtribution^ And, given its inherent uncertainties it becomes hazardous 
to attempt to predict the areas in which such outcomes will occur. But 
without it the well of new thinking frequently runs dry. It Is therefore 
vital that a healthy and mature R/D&I system will have developed and main- 
.tained a substantial high quality basic research component. 

Such a component cannot be built quickly. The rate at which quality 
basic research can be expanded is limited by the size and quality of its 
existing centers of excellence (which may range from a single outstanding 
tieseatcher to a team of such researchers). To pump more funding into thi^ 
endeavor than such centers can usefully absorb can only lead to waste and 
' disappointment. Future growth is (and will be) limited by past invest- 
ments in creating and supporting a central core of basic research having* 
many centers of excellence. The major problem of basic research within 
education as a .field of study per se has been as we noted in the very 
weakness of this centajtal core. - . • 

Assessment of the basic research function will need then to be based on: 

1. The size and /quality (based on the reputation of institutions and 
personnel) of the central core of the basic research function '4 — most 
specifically on the size, growth anc| stability patteims of identified 
centers of excellence. An important indicator will be the ability , to 
attract and hold top flight researchers. 

2. The number o£ new centeris of excellence seeded and taking root over 
success iVetixolling) 3-5 year periods. 

3. A measure of the supportlveness of the climate - In terms of funding ' ! 
growth and stability over several year periods. ^ ^ ^ 



4, Measures of the quality of linkage to. and reputation of basic 

reaedrch ineducation and its more fundamental root disciplines (e.g. 
psychologyTsociology, etc.). 



5, Over long (10-20 year) time spans', an assessment of major substantive 
contributions to knowledge coming from educational basic research. 



Current Status 



We have seen that basic research in education is gei^erally to be found in 
two types of settings. That located in schools of education (frequently 

"in such disciplines as educational psychology and sociology) boasts few 
centers of excellence and much Wediocrity. A different picture emerged 
from viewing the research carried on in discipline b^sed university depart- 
ments such as psychology and sociology. Excellence and valuable con- 
tributlons to 'knowledge are to be found, but what has been lacking here 
has been a primary and continuous commitment to education. The inter- 
disciplinary character of educational research has adcfed to the diffuse- 
ness; by making communications and informaition ♦"retrieval (from the large 
variety of publication spurces) very difficult. Altogether, this has 
added up to an educational basic research commilnity that has been to 

y date unstable and amorphous. It makes system building in this area a 
major requirement and a critical consideration in funding programs. 

At the same time, the general climate for basic research in education 
as for other (especially social) areas of basic research has been far 
from supportive. This negative climate has been particularly intense 
for education which has been hard put to point to more than a handful 
of significant developments that are traceable to basic research. The 
low prestige wilfh the general public and with Congress and the associated 
unreliable ^^funding have made it hard to attract ^trong talent and this 
has acted as a major constraint on building the central core. As regards 
funding, it is vital to note that there are many agencies which fund 
basic research in education. Indeed, the National Institute of Education 
(which has been assigned "lead" responsibility for educational research 
and' development) haa been a. relatively minor contributor to tife total 
funding going to basic research, especially in comparison with such an 
agency as NIH. 
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Key Needs 

■ ' ■• ■ ■ / • 

In light of the above summary analysis of the distinctive requirements 

• of basic research ai|^ the current state of development of this function 

in educiatlon, the key -need would seetn'l^to be for a consistent, Continuous, 

stable process of system building. !rhis would include: 

1. identifying existing centers of excellence; 

2. facilitating the establishment of additional, denters of ^cellence; • 

3. facilitating the growth of these cei^teps, existing aftd n^w;* ■-■■-'{ , * 

4. facilitating improved iitfo«i^tion. exdharige^^ rfetfieyail mechi^nidll^; \. ^ * 
.. 5. providing stable^ Idhg^tertf^w^lng;:-.'^^ *^tr5«.'^' v , . "^vf ".^ , 

B. Applied Research V » " ' . V ' : »v "^.^ . 



Assessment Basis 




> 



It is important to be reminded that applied researbli yLs research and.^hare^i ' ;^ 
with basic research a high leA^el. i^fe im^ unpfe^ictabllit^/^^^ ^ 

researcixers ii;i particuij^r trea^ a^plifed research' in a^b^sic-^^^ mode ,. ; 

But it Is also 'tatgettejd resBarchi^*^^ TIjus,^*' runder^ '/ari^ users often assupQ^; 
it to have" the leyel- odft certaj^nty arid shortriess* af tima line -more jappropri-., : 
ately associate^ with developitnerit .v •Thi|' d«ie^ivetiess and the ctmsMueri . 
inherent t&iSidn makes dppiied- ie$^ai?ch/^bj(ict: cdnsider^fil^^n^tabil 
misdirection and- mlsm^nagetogit , and coM^iifem^^M asS^^s^^ 



Researchers "freq^jentStyj redefine and bend applied research .4tit<) Jj.asi^c 
research modes; In particular, they * often ,artei*t to undertake projects * 
on smaller scales thatl ^ar'e reduii*ed by thjL^^ the problems » 'which 

-.y... - ■ . /, , .-M] . ; . ^ ■. •- 
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often require the efforts of large-scale Interdisciplinary and empirically 

j>ased team prdgrams* This syndr^fte Is often combined with attempts to 

' ■ •, ■ ' • . . • * 

oversell the timing /"probability and Impact of outcomes In order to obtain 
ftmdlnjg. This' often succeeds with f under s simply because applied research 
projects do appear to have pra^lcal, attainable outcomes. All of this 
*-j|preates an envltonment that tends to be unattractive to many. of the best 
researchers.-/ ' * 



On the otih^r side, users and fun^ers, havln^.'been persuaded to* fund such 
programs because of these very expectations of near-time benefits , become 
frustrated by not only the lack of delivery but alsc^by the ^©hlf ting 
targets, time and cost patterns which are Inherent In the uncertal^ research 
prbcess. 

Another important dimension of this tension lies In the proT;|3.em of need 



Identification. On the one hanc^ the objective Is to work on Important 

V ^ 7 K ' 

• ^' and timely problems that requli/e solution, i^^d^hls tgp'ds to be the prime 

^ \ 'J 

' . Inducement for the users and /unders." On the other hand, ^ researcher Is 

• . *. » ' ■ / 

r^tiulr;fed ' to maintain the criteria of researchablllty — criteria that 
often slgnlf Icaetly llmit^ the utility of the project from the user per- 
sp^ttlve. This ast-'well as the 'previously mentioned problems of tfenslon 
"Ny^. becomfe magnified when one recognizes that the cost and scale of applied 
^ ' ^ reseiirch tend to tun orders of magnitude higher than what Is typical of 

j * btela research .W * ^ 

. » ■ . " 

Xssessmfent mu^t theisefore be based on judgments of : ^ \ 

1. fhe "quality apd appropriateness of the institutions performing this 
. ' function: ^ ■ 

^ Are they capable of mounting the^requlred ikrge sc^e l)ater- 
?? ^ V r dlsclpllnay^* efforts? 

^ Are they attracting, aAd .keeping top quality applied researchers? 

Are their programs and projects considered to be of high quality, 
Important to practice and on truly researchable "problems? 



J'* 



r*/2V Whether applied research is emerging as^a definable entity, differen- 
r tlated from basic research and dei/elopm&fjt * 
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3. After a time lag that reflects several years of sustained system 
buildings an evaluation of the rate and Impact of outputs. 

\ I • 

4* 'The climate for applied research dn terms of both support patterns 
and receptivity to Its outputs. 

Current Status " 

Most of the research that Is carrdLed on In education appears to be what 
might loosely be defined as the applied type^ much of It unfunded and 
small-scale. The volume of studies produced may Indeed by large —I but 
being of this small-scale, scattered and fragmented quality , these have ^ 
been subject to many questions of quality. It Is evident (as mentioned 
earlier) that there Is substantial lack of differentiation In education 
between what can truly be classified as research and various other acti- 
vities (e^g. : demonstration projects » social bookkeeping etc.) ; great 
weakness* In defining researchable problems; considerable fuzzlness In 
differentiating applied research from basic research and development; and 

the previously mentioned tendency to oversell such projects. ^ 

^ ■ ■ 

As we noted earlier, applied research in education is largely carried 
on In two types of lii^tltutlonal settings: universities and large-scale 

R&D Institutions In the private and qu£lsl-publlc sectors. *> 

. . . ■ 5 

Where this work has^gone on In universities, there has been a tendency 
to perform applied Research In. a basic research mode. This Is not sur- 
prising gtven the socialization and prior training of university researchers 
£tnd the social and publication pressures under which they operatel Generally, 
universities' find It difficult to assemble the minimum critical mass of 
effort needed to undertake large-scale applied research projects. As 
a consequence, they have tended to scale such projects down and/or to 
assemble ad hoc teams that lack lon^range-^ stability. With this has come 
the unfortunate tendency for researchers to move In and out of this part 
of the field 'Which has mitigated against system-bulldlng requirements. 



Large scale R&D organizations should haVe bden, and to some degree have 
beea> more suitable sites for such' progftaijOLS. However, two Important 
problems have limited their potential ^c^ass. Firstly, most of these 
R&D organizations have not been able to pi;c(mlse a stable^ cai;eer path to 
researchers, thereby greatly limiting their ability to attract and hold 
first-rate researchers. Secpndly, federal funding practices In the late 
*60s shifted the character of many of thes^ Institutions away from applied 
research and reshaped them Into developmet^ cjrganlzatlons In accord with 

federal priorities at that time for product-centered Impact strategies • 

■ j 

As a consequence of the above conditions, education has In fact seen very 
little applied research. !ni Jref ore, . this .Ips to be seen as an area that 
needs to be put together at this time* In Its own terms and not be thought 
of as a form of advanced development or downstream basic research. 

A number of other problems In educational applied research were previously 
Implied but require further explication. T}ie climate for such research 
has been perhaps even more negative than that described above for basic 
research. This has been so precisely because it seemed to hold out mor^ 
promise of impact and raised expectations than could have been satisfied J 
— given the Inherent time frame and the weak state of the area. Relatedly, 
need identification, which ha*d been reselircher-driven up through the mld- 
*60s, became system-driven by users and funders in an overreactlon to 
this state of affairs. As with basic research, funding has been realtlvely 
limited. - • ^ 



Key Needs 

Applied research in education, then, must be seeii in a system-building 
mode • I « , 

1. It will be essential to locate those centers of excellence capable 
of performing large-scalpe applied research. 
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2. Such Institutions will need to be provided with the kind of long- 
term stable funding that will permit them to attract and retain 
top-flight staffs of researchers. 

3. It will also be vital for the lead educational funding agencies to 
help practitioners and the Congress understand the nature and re^ 

* qulrements of applied research to: 

understand that project selection requires the deter min ation 
of what Is rese^rchable as well as what Is Important; 



A. 



recognize that^he present lack of capacity demands a period 
of Instltutlon-bulldln 
bfegln to be fulfilled; 



of Instltutlon-bulldlng before the promise of the^ area can 



and understand that such Instltutlon-bulldlng will require an 
Qongolng and long-term commitment. 




XII. DEVELOPMENT 



^ 1 ■ 

As Jescribed in the , literature, the development function in education adheres 
strictly to the engineering model of development used in .industry. But the 
development function described In the , literature represents only a portion 
of all development work that Is done in the education sector the 
development mode as it is carried out in pursuanceoof government contracts, 
primarily in regional laboratories and in some of the non-profit and 
for-profit research and R&D corporations. If we accept a broader and less 
rigorous definition of development work, then we must dlso include several 
•other models of the development function as this is carried out by class- 
room teachers, by curriculum specialists in'SEAs, ISAs and LEAs, by textbook 
publishers, an* in university-based curriculum projects. 



6'^ 
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1. Development as an Institutionalized Functional Specialty (Using the 
Rigorous Development Model) ' / 

Considering ^jj^^^ the rigorous definition of the development jEunctlon as an 
institutionalized specialty that Is carried out by specialized personnel 
in specialized Institutions or organizational units, development activities 
are systematic and sequential. Development moves In a smooth progression 
from prototype design that Is the end product of the applied research phase 
of R/D&I; to product or program development In accordance with detailed 
specifications; to evaluation of small field tests; to revisions; to 
larger field tests; to more revisions; to an additional field test; etc. 
until the product performs In accord with the prespeclfled performance ob- 
jectives. Products go through successive generations of revisions, each a 
closer and closer approximation to the performance specifications. Revl* 
slons are based on empirical field test data that are gathered systematically 
and analyzed rigorously* The evaluation data provide the potential user 
l^rlth precise Information about the outcome or effects to be expected from 
use of the product under specified implementation conditions. ^^^^ 

Development projects Implemented In /accord with this model tend to be large- 
scale and expensive; Involve large personnel base pools and hetei^ogenous 
skill mixes; and Involve extensive cooperation between the R6eD organizations 
developing the products and the school systems agreeing to serve as field 
test sites. The product's themselves are often complex, consisting of many 
and varied modules or componaiits, and often several forms of media as well 
as printed matferlals. The management of these complex clevelopment projects 

is often highly formalized, using flow charts and sophisticated iqanagement 

^ , (60, 66, 116) 
tools. 



There may be some variations In pattern depending on the nature of the. R&D 
outcome being developed — e.g.: products vs. change processes^ However, 
the ls3ues of concern to managers tend to be consistent: How much research 
is needed prior to the development work? How much research can proceed 
parallel* to the develo^^nent work? At what point Is the product sufficiently 
developed to permit Initial field testing? At what point has the product 
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been tested sufficiently to permit dissemination? What dissemination, mar* 

keti^gy and Implementation factors need to be considered throughout the 

4#sign and development phase? At .what point does the responsibility of the 

developer end: development? dissemination? installation? utilization 

. (7) 
and maintenance? 

2, Development in the Education Sector 

These issues are to some extent common to the development function in all 
sectors, but they take on particular'signif icance in the education sector. 
The' weakness of the knowledge and technology base of the field makes it morfe 
difficult to translate performance specifications into effective products. 
Outcomes are far l^ss predictable given the reactiveness of the user setting 
and limited technical capability of user personnel to implement complex 
innovations without substantial implementation supports,. Consequently, 
development work in education requires a far greater investment of tinie 
and money in the research and evaluation components of the development 
process, making development costs high relative to practical payoffs — 

•UK ■ ' 

a problem of particular importance considering the negative political 
climate in which educational R&D appropriations are made. 

— ♦ 
The rigdfous model of ' the development function as it is used in the regional 

laboratories can be contrasted to the more traditional approaches to 'the 

design and development of instructional str;ategies and materials — as 

these activities^ have beian carried out by classroom teachers; by curriculum 

specialists in the SEAs, LEAs, and the universities; by publishers; and by 

the university scholars who have on occasion participated in efforts to 

improve K-12 level curricula ahd instructional materials in their areas of 

specialization. ^ i 

The 'development approach used in these settings tends to be intuitive rather 
than data-based or grounded in theory. The focus of attention is generally 
on the content to be conveyed rather than conception of how students learn 
or how teachers go about providing instruction. Field testing is non- 
existent or minimal. Development costs are relatively low. The personnel 
involved relatively few (e.g.: one teacher, a few scholars or curriculum 



•paclallstt, etcOi And whatever skill mixes are present in a development 
team tend to be relatively homogenous. Management Is generally informal 
and highly flexible. Vlhere textbooks or materials packages are being 
developed for large-scale, nationwide dissemination, an effort is usually 
made to Include Implementation supports in the form of teachers' guides, 
tests, etc. » Whete materials are developed locally for use by a single 
teacher ofs a group of teachers in a single school or district, far less 
of the implementation process is committed to print or media presentation; 
the state of ''development** of the materials or strategies for use outside this 
small group remains inadequate; ^and either the locally developed innovations 
are not disseminated at all or they ^re disseminated but have minimal success 
elsewhere because development work was not carried far enough to permit the 
materials to be implemented easily and effectively by others* 

3^ Changing Patterns of Federal Support for Educational Development 

The rigorous ^development model is likely to permit more effective implementation 
of • developed pro^uots. However, consideration must also be given to the high 
costs of rigorous development work, the relatively limited utilization of ^ 
externally developed R&D prodiictTs to date, and t;he extensive amount of local 
innovation that exists. Thus, federal policymakers are giving increasing 
attention to internal user system development resources — building internal 
innovatiory capabilities ; linking internal sources of innovation^ to external 
resources for documenting and analyzing local innovations and developing 
materials that could be used to assist other school systems in implementing 
these locally developed programs and practices (e.g. : OE programs in support 
of SEA efforts to identify, validate, and package exemplary practices; NIE- 
supported programs to t)uild SEA dissemination capabilities and LEA problem 
solving capabilities). The bulk of federal development resources appear still 
to be awarded to external R&D organizations that use the engineering model. 
(We will be in a better position to verify this impression after data from 
NIE's' current survey of^lCPU organizations are gathered and analyzed.) However, 
it seeiT^s possible that this balance may change in time. If this does happen, 
the character of the development function (as this is generally understood in 
the educational R/D6tl community) may undergo considerable change, and with-it 
the insticutional bases,^ the personnel base, and especially the technology ^ 
of the development function. 



4, Th> Putura 

If the dev«lopifc«nt function in education were. mature, we voul4 expect to 
\ find a large i\ipply of high quality outputs that are responsive to user ' 
needs. Since most available outputs of educational development appear to 
be weal/in both quality and responsiveness, futujfe strategies for strength- 
ening this function must be based op consideration of the essential require- 
ments of the development function and the major vemluiesses of each of the 
two predominant modes of development work in the education field/ 

As we noted in the discussion of the future of educational research, to 
think about the future of the development function in education, we will need 
. to review our understanding of the basis upon which the educational develop- 
ment function nlay be assessed and of its current state. From these we may 
suggest'fcey needs for^Jihe future of the development function in education. 

Aasesstaent Basis 

As we have noted, critical in the assessment of the development component of 
an R/D&I system is the recognition of the centrality of its linkages to 
the user, to production and to the state of art in development. Development 
has a relatively mote predictable and shorter time horizon process as com- 
pared to the research functions^ It aims to convert knowledge^ into user- 
ready products ^ products which may (or may not) need to pass through' a 
distinct production phase before they can be disseminated or distributed. 
With the linkage to the user being so critical, so is the requirement for 

neted identification a step that is difficult to perform, but one that 

must be done well and of t^n in an ongoing manner during the development 

process (where complete identification is not feasible as in many. 

areas of social development? if the product selected fbr development la to 
be on target. > . 

Development is also highly dependent on the quality of its linkage to the 
state of the art and on the skills and motivation with which products are 
designed so as to be capable of production and dissemination. This deter- 
mines the effectiveness and viability of the product. , ' 
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since develdpment is frequently carried out in specialized development 
organizations it is highly dependent on the quality of such Institutions 
and their personnel and most particularly on their experience. It is 
important|j||> differentiate the concept of excellence in development from 
that used in research. In development, excellence is measuried by being 
cost /affective, timely and opportunistic. With such criteria, exj^erience 
(Individual and organizational) and thoroughness (ability to do the whole 
job) are often more Important than brilliance. Where development is carried* 
piit in a user setting, then* assessment must be concerned with the extent 
af wider dissemination of fhe products or processes developed. 



Thus, the critical bases for assessment are; 



, U. Quality of, linkages to: 



-.users 

Tj- production , • 

-development state of the art. 



Measures of 3uch linkages are hare} to define knd obtain, depending 
.as they do upon quality, frequency and form ojc ii^teraction. They 
will likely he>qualitative in naturiBj' and "observable" more in 
their absence in'terms of problems generated, than in their 
presence. _ / 
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A specific manifestation of tl^iis linkage will be in the quality 
of need identification, to be measured indirectly by"tli^rele-- 
vance of devel</pmeht outputs for practice, and .by the scope and 
•effectiveness of feedforward activity from users to developers. 

Namber and effectiveness of large-scale development organiza- 
tions. Effectiveness here would be measurable in terms of 
extent of adopted prodiicts and some qualitative assessment 
of impact (at tual and potential) . . ^' 
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^. 3. ExtjBnt of dissMiination of practice-based develppmeats. 

' ■ ■ ' '■'■'}'' 

4. The nuxaber and quality of products developed* from the vhole 

R/D&r system and their over iall (portfolio) effect. Quality; 

^ . ■ ■ ■ • ■ ■* - 

would again have to be '"measured by usage based criteria although 

the locus of quality control would be a de^sign variable. 



Current '^Status 

. . ■ ■ : ■ . ;f ■ ■ ■ . . , . 

As ve have discussed ^ educational develojpmen^ is plagued by a weak 
knowledge base. The quality of Information Is poor ^ very little has 
been codified. As sudh, quality control is a central requirement, which 
has only recehtly begxm to receive serious attention but which is still 
' relatively poorly developed and its enfcjrcement a mafctger oi ^some dif- 
fusenesst as to locus, of responsibility. SsMth limited ability to ^depend 
on quality control in the field,, fund'ers and^ogram managers may need 
to build quality control checkpoints into staged development procurements, 
a procedure that demands closer Involvement and orchestration between . 
key funding agencies and th^ field than has been typical to date. 

We noted earlier that' there are two distinctive modes of development 
work in education: 

a. development work that adheres to the rigorous development model 
and tends to go on in specialized development organization's ;»* 

b. more conventional. Intuitive modes o j g|||^ elopment that tend 
, to be carried on as part-time activi^BWln practice-based 

. settings. . ' , ' 7.. . > 

At their best, specialized development organizations represint a strong 
element in educational R&D system capacity". There are. a few such well 
staffed and experlet^ced development organizations and their existence 
is an important indicator of the system building that has gone on. More 
often, however, the institutions and personnel involved in development 




do not come up to these required standards. Even the best of these 
organizations tend to suffer from Isolation from practice, making dis- 
semination aixd Implementation problematical. This may be one d£ thV 
causes pf the limited utilization of R&D based products, a shortcoming s 
that is tending to threaten the viability of this. t3rpe of institution. 
There may be a critical need in development not to Increase the level 
of effort overall (there 1$ an Inventory of more, than half a million R&D 
products that are available for sorting, tailoring, packa|ing and dis-- 
semination) but rather for a shift of ^|)hasis so as to biiird up more 
of the strong high quality development organizations with whom the gov- 
ernment can >t;bntract and to, ensure their closer linkage to practice. 

The second basic mode of development In education (practice-based) does 
not suffer (obviously) from poor linkage to the user. It does suffer, 
however, from inefficiency,' lack of sophisticated skillj, poor documen- 
tation of its achievements, dif f IcujLties with packaging, and from 
enormous problems in achieving wider dissemination and diffusion. State 
initiatives have become particularly significant in recent years in 
identifying, packaging and dissen^nating exemplary practices and programs 

developed by local school systems. The verdict is not in as to whether 

■ ■ ■ j» 

this mode can become a source for wider application (beyond the local 
development site). Meanwhile, further research on this mode is required 
as well as support for efforts to supplement and'bqmnd local capabilities^ 
possibly through increased linkage and' collaboratlop between practice 
based development and specialized development organizations. 

In tfie area of project selection the emphasis tb/^ate has been on a 
project-by-project selection process. Missing has been the capacity in 
y^^^^ystem , to consider critical portfolio effects. These could Involve. 
■j^^^^^^^^^^/'^^^^^ and concentrate development programs so as to achieve 
^Synergistic benefltsV^^^^^^^^^^ sequencing strategies that minimize user 



^^^sr^^ption and ^tincertaint^ cppperatlve ventures across agencies, etc. 

■;Particul^rly fimportan^ to' develop skills in commerclall- 

/zation so as^ to toke^^^^ decisions with respect to what to place with 

' which elenent^^ of 'tnee p^^ sector and when. 



■ Key Needs V 

With the above in mind, the following would appear to be key needs for 
the educational development function, particularly with reference to 
the role of key funding agencies, 

•m 

1. Work with the field to build u^J^^the explicit designing-in of 
quality control fiitgictions into funded development programs - 
possibly including staged programs with quality control check- 
points. 4 

2. Shift support emphasis to favor those high quality specializ^ 
development organizations that ahow a pattern of being respon- 
slve to practice needs and to technical opportunity. 

3. Work with SEAs and LEAs to determine the modt cost effective 
ways of idei^i^^fylng and disseniinating practice based develop- 
ment products, 

4. Study and experiment with strategies Resigned to Improve the 
interface between the government funded development organi- 
zations and commercial f ii^ - - including development of 
criteria for what should be handled how and by' whom. 

5. Development .of progr-am planning ^nd^roject selection methods 
by key funding agencies that givfe explicit consideration to 
portfolio effects. 

. ' ' ■■ • . : ■ ' ■ 

6. Explicit programs designed to achieve inter-agency cooperation 
for development activities. 

7. Study and experimentation with strategies designed to improve 
the interface between' the government funded development organi- 
zations and commercial firms - - including development of 

* criteria for what should be handled how and by whom. 



XIII. PRODUCTION 

Production issues are of mirtimal concern at this poiijt in the historical 
development of the educational R/D&I ^system. As we use the term, the 
production f ui;iction is restricted simply to the reproduction or manufacturing 
in quant^jr^'f a fully developed and tested item. All design and development 
vork is roi^umed under the research, development, and evaluation research 
Unctions. For the most part, production in the education sector takes ' 
place in the subordinate system of institutions that provide support services 
•to the educational R/D&I system — ^.ipublishers , film production companies, 
manufacturers pf*^hardware and equipment, etc* These production instirtutions 
tend to be iBector-spanning in natut(e, and none of ,the production issues that 
come int^^^lay appear to be sector-specific to education: 



Production issues are of^ relatively low priority in, the education sector. The 
overwhelming majority of .educational products and R/D&I outputs tend to be 
software gather than hardware; the predominant medium i'S print; and the 
- key issues of performance and reliability have less to do with possible 
breakd^yis in the production function than with weaknesses in the development 
function or the implementation process. Commercial publishers generally 
strive for, a high quality print product using costly materials and production 
technique's. On the other hand, the gloss of commercial publications is 
generally absent from the outputs of R/D6el organizations. To some 
significant degree, this appears to be a consequence of clearly articulated 
poJ.icy decisions of educational R/D&I sponsors and contractors. Educational 
R/D&I decision makers have opted consciously for allocating maximal resources to 
the research, design, development, and evaluation of the .substance of the 
materials, and the barest minimum to production just enough' to insure 

that a sufficient quantity -of usable materials can be distributed to 
operating systems. . " 

Some recent initiatives\ave been taken to develop collaborative relation- 
ships* between R/D&I organizations with strong development capabilities and 
commer^al publishers \<ho can add high quality production capabilities 
(e.g.: a^angements between Appleton Century Crofts and the developers of 
Individually Prescribed Instruction). However, these'^ arrangements i are relatively 
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■ - ■•■ . f . 'I ^; ^■v". .•■ 

few in number; the linkages aire teatativ6* and exfp^rimental ; 
I .production function is barely visible *in the configuratiorl o£ c^SSciiti 

r R/D&i. ;, -^^ ' .-. ^ ■ ';;^-wiv--^^^-' ■ 

■ ' ^ ' n' ' A ■ 

XIV, MARKETING/DISTRIBUTION/DISSEMINATION/DIFF^^ 

V The linkage functions of marketlng/distritfutfion/dissemiM 

have always been ainofng' the weakesit corapoB/ents of educatibrial R/D&I, aad 
have only recently become the focus of federal and state R/D&I policies. 
•Each of these functions has had a number of traditional meanings, each 
with its own set of institutions, ch$innels,> and characteristic activities. 
New conceptions of these linkage functions are^gaining wider acceptance; 
and new institutions, channels, and activities afe^iappearing to operational- 
ize the newer approaches. ' . 



An Emphasis on Information Flow 



Until recently, the dissemination function has been concerned primatily with 
the flow of inffigrmation the outputs 'of research — rather than the 

marketing and distribution of packaged R&D- products . Further, dissemination 
stijategies have been so passive and uncoordinated that the burden of effort 
in retrieval was on the researchers and practitioners seeking information. * 
The characteristic channels have been publications reports of' research 

-findings in .technical reports to sponsors or in scholarly journal articles 
targetted at the research coimuunity; or in non-technical, f onii in .articles 
appearing in the magazines and newspapers read by prdctiti^oners and 
laymen. Informal, interpersonal information exchanges 'took place at 
professional association meetings of researchers and a^T'bther meetings of 
practitioners, and at occasional conferences, seminars, or workshops. The 

universities and teacher-training institutions ^liso performed a key role 

> . • / ' . \ 

in passing dri a field's knowledge base in pre-service training programs, 

or in updating knowledge and skills through in-serVice training. For the 

most part, l^ever, this pattern involved dissemination 4^f -individual 

pieces of information with a potential for apjilication j^ther than 

package^^informatioh products designed to produce changers in practice. 



I 



/i i|fhe exceptions here were the, publishers *and equipment manufacturers who 

•/packaged Information or technological products Into immediately usable 

»&; forms and had well developed n^arketing and distribution oj^rations to 

' get their products into the hands of practitioners with a minimum of 
'I 

effort on the part* of user systeta personnel. . 



Dissemination in the '60s; The Impact of Federal Policies 



..Federal R/D&I policies in the '6Qs added several new dimensions to the then 
existing modes of dissemination^ The crowning glory of the information \ 
d£ssemination/t>olicy was the massive ERIC system created by QE to acquire,^ 
store, abstract y and provide easy computerized retr4.eval of sources from 
the extensive) fugitive , literature of the education sector. ERIC also 
provided publications that announced' acquisitions to' the field and 
therefore was expected to make them more Vj^sible; indexed the Journal 
literature of the field as well as the fugitive literature stored in 
the ERIC collection; and provided several hundred information analysis 
products that synthesized information - in" selected topical areas.* (,Fro- 
feissional associations of both researchers and practitioners also bi^ieceme 
active in the '6O9 in producing targetted information analysis products 
or synthesis of the available knowledge and technology base in specific 
.research areas — e.g^, the National Education Association's What Resei^rch 
isays to the Teacher pamphlet series; two edifcions of the Handbook on Research 
in Teaching ; * and four editions of the annual Review of Research in 

Education . ^^^^) However, ERIC has been repeatedly criticized 
as geared largely to the^ needs of researchers rather than practitionejus. 
^ More" recently, in response to practitioner needs , ERIC acquisition programs 
have included efforts focused on storage and retrieval of curriculum 
packages and other development products (e.g.: product information packages) . 
As yet, ERIC appears to be used little by practitioners. 

The., network of institutions created by the federal government "iit the ^603 * 
included organizations charged with responsibility for acquiring and dis- 
j^inating instructional^ materials in given areas (e.g.: The Instructional 
M^erials Centers) and organizations designed to demonst^rate and disseminate 
exemplary local practices (the/^SEA Title III demoristra'tion centers) . Disr 
semination of the R6D outpufs o^ the laboratories and centers was considered .. 

ERIC 



a major function of these orgat^lzations . Categorical programs (e.g.: 
ESEA Title I, Upward Bound, programs for the handicapped, vocational/ 
career education) have always included dissemination components. Addi- 
tionally, various referral organizations (e.g.: the National Referral 
Center and Phi Delta Kappa* s School Research Information Service) and 
other more active and interactive approaches to diss €;minat ion (e.g.: 
education information cetlters with education extension agents ^^^^) 
alsp began to appear in the '60s. Still, despite all these initiatives, 
by the early '70s it, seemed clear that the outputs of educational research 
and R&D were not reaching the user system to any significant degree or 
having clearly visible impact on improying educational practice- 

• ■ ' ■ ■ \v V " 

3. Federal Dissemination Programs * . 

Current f,ederal dissemination programs have vi^Ben built on many of the in- 
itiatives 'of th6 '60s, but carry them further and change the focus of federal 
^6semination strategies^* Historically, the overall federal, strategy could' 

be characterized as: ✓ * 

i (112) 

1. initially one of laissez-faire- ' (prior to the mid-'6^ 

^ ^ the initial conception of ERIC as a passive informatio 

(112) 

2. then a strategy bf product advocacy ' (the Instructional. Materials 
Centers, laboratories and| centers, and Title III demopstrati0r^ centers 
advocating the use of particular products or programs they selected 

or developed); 

3. and finally, strategies of * 

■t 

a . coordination 'of e^ls ting discrete ^efforts , . and 




^ change process advocacy , ^"^^^^ replacing advocacy of particular 
programs and products with informational and capability building 
approaches^' providing extensive amounts of (and easy access to) 
^ information on the full arra>^of available products, programs, 



and practices to meet given needs; providing easy access to 
education extension agents in local education information 

. centers; developing users' capability for evaluating, adapting 

' * » ' * (29 83 9 4^ 

and implementing the products of their choice. ^ ' » ' 

The federal role is seenas one of facilitating, coordinating, and providing 
start-up flinds to mobil^R state and local dissemination resources. The 
focus is on building networks that bring together and strengthen the dissemina- * 
tion resources of existing organisations that carry out dissemination activities, 
especially the SEAs. ^^^^ 

\^ ■ ■■ ■ ) ' ■ 

The approaches that Have been funded tend to be active and interpersonal — 
e.g.: .^iporking thro\ig4 educatipnal extension agents, local education informa- 
tion centers , netwojrks of^ Interactive computerized retrieval 
m^h^nis^. EducatJL^^ agents and other ^personnel^working in local 
di^ricts are linked to centralized resources and specialists; information 
needs of local us/rs are determined; information and materials required to meet 
these needs are transformed into packages tailored to the user's needs and con- 
straints; and followup supports and feedback mechanisms are built into the over- 
(29 *127) 

all design. .* To date, these systems have been developed extensively in 

relatively few states, though the number and scope of these programs are expand- 
ing under NIE dissemination capacity building grants ^o states. Clearly, this 
active, interpersonal, user-oriented a^ field-based networking s t^^|^||^J^the 
direction in which ^edjic at iorlal disserjiinati^n in the U.S. is mo^{J 

4. The Current State of Dissemination . 

Clearly, the institutional base of the dissemination function has undergone 
extensive development in fecei^B|reai^s . Considerably mpre expansiop is likely 
If NIE'/ Research and Det^elopmenr Exchange progifam (currently in the planning 
3tages) becomes operational. Nonetheless, it will be some time before we can 
2xpect to find substantial impact in the form of widespread improvement in' 
educational practice. There have been serious efforts to synthesize the ^ 
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theoretical knoVlfedge base of the function , "^^^ but the translation of 

this knowledge base into usable strategies with known effects is only begin- 
ning. - The dissemination specialty is only now beginning to appear and is clearly^ 
inadequate for the scope of existing programs such as the Research and Devel- 
opment Exchange program noted above. Most of those currently carrying out 
dissemination activities appear to be practitioners by training. They ^re 
proceeding iijituitively and learning the dissemination field on th6 job. Few 
programs ^re available tOv^train dissemination ispecialists. 

Until recently, the linkage funct^ions of marketing/distribution/dissemlna- 
tion/dif fusion have been among the critical gaps in the educ^ional R/D&I 
structure. There are hopeful signs that dissemination and diffusion 

are maturing. But despite all the discussion in recent years of bringing ' 

* f 5 6 2 ^ 

a marketing approach to education,^ ' ^ and despite the current focus, on user 

C83 85 87 94^ 

needs and user viewpoints, ' ' ' the marketing perspective is almost 

totally absent and may in fact have been buried altogether by the change in 
strategy from product advocacy to change process advocacy. A distribution 
system for other than conventional commercial products is also lacking. The 
manner in which the emerging dissemination net\york may become (or 
become linked to) a distribution system is still unclear. 

o 

5 / The Future 

'■ ' 

At the present point in time, the linkage functions of market ing/d is - 
tribution/disseraination/^f fusion, must fee assessed as /underdeveloped 
and weak in their impact on the user system. If they are to be strength- 
ened, collaborative federal/state/.local and private/public initiativ'iijp 
will be needed, designed specifically to take into account the efllfential 
requirements of the dissemination/ linkage functions and the 'current 
state of development of these functionis in the field of education. As 
a basis for suggesting key needs, we will review 'our understandings of 
its assessment basis and current status. In our discussion here, we 
will focus on dissemination. 
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sessment Basis 

The function of dissemination is critical to the entire R/D6el system. 
It is, in essence, a linkage process which "connects" knowledge producers 
with^ knowledge users. Thus, as we have been implying, the R/D6cl dis- 
semination system must provide for mechanises which; can determine what 
is available; can sort out the "good" from the "bad"; will allow users 
to identify and jobtain the particular products which are relevant to 
their needs; as needed, can "tailor" products to fit user needs; can 
motivate users to "try" a product; insures effective user implementation 
and utilization. * . ^ 

% Assessment, then, must ^be made in terms of capacity to achieve and 
success in each of the above requirement^^ Overall we would wish to 
know i^his with respect to: , 

1. Extent and quality of "reach" into user systems (e.g.: number 
being reached, the extent of repeat utilization of dissemination 
services, and user satisfaction with such service). 

2. LeveLs of user awareness and trial of R&D products (ex- 
. istence, character, and evaluative) • 

/ ■ ■ • ' 

3. Contribution to implementation- and utilization of R&D 
products. Since this depends on such other factors as 
number and quality of products available, user skills and 
receptivity, etc., the dissemination function can only be 
assessed as a contributor to the process. This must of 
necessity.be a qualitative evaluation. 

V 

4. The existence of a^vell developed and cooperative' network 
of dissemination mechanisms giving coverage across the 
nation and to the variety of users to be found. 



Current Status 

In education, we find a number of problems and barriers to dissemina- 



/ 
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tlon. There are an enormous number ol users (some 17,000 school 
districts . - - plus teachers, etc.)>'^ong whom there, is wide diver- 
sity and variety as to philosophy, interests, perceived needs^, etc. 
Innovations make demands on the time Sf school personnel (a very 
practical matter) ^d generally require "people change" - - factors 
which can lead to resistance to innovation. Additionally, at least two 
major factors have tended ,to create a very poor climate fox dissemina- 
tion in education: (1) a lack of implementation/utilization support 
to the user; and (2) the perception that the outputs of the (for 
the most part) newly created R6cD system have generally been inferior 
to existing user-developed products. 

In education^ there has been a considerable amount of activity that 
haf been called dissemina{;lon, and a large number and variety of organi- 
zations are involved in srome kind of dissemination - - but much of 
this has bee^ fragmented and scattered (e.g.: "add-ons" to development 
projects; successful but separate and discrete dissemination systems 
for specific categorical programs j.*^^.As yet, however, there is r'elative- 
ly little coordination of federal, state and local resources nation- 
wide, and no systematic way of tapping into the whole nationwide 
resource base. Further, there is not yet a well developed personnel 
base of trained dissemination specialists. Several federally funded 
programs have been developed in recent years for training dissemina- 
tion and utilization specialists, but dissemination mechanisms, are 
expanding far more rapidly, and creating a far greater demand for 
trained personnel than these programs could even hope to keep up with^. 

Key Needs * % 

From an overview perspective^ then» thiB need is for: 

1. orchestration of educational R/D&I dissemination from a total 
system perspective ; 

2. in the short term, facilitating the work of existing dis^mi- 
nation mechanisms and "filling" critical "gaps"; 



3. in the long term, providing for overall system building (this 
/ calls for policies and strategies which are proactive, not 

passive or reactive, and which are based on a knowledge of 
what does and does not In fact exist); and 

4. balancing short andr*long term needs. 

* ■ •■ , 

Kore specifically, policies and strategies federal funding agencies will 
need to be developed in collaboration with the states to focus upon: 

1* quality control; 

. ' %i ■ • 

2. jmechanisms that can optimize product /dissemination/user "fits";* 

3, providing users with alternative channels of acce^ss to the 
avi^lable resource base^(a "mixed strategy" approach). 

Keeping in mind the limited level and rate at which users can absorb new 
input once a dissemination system is established (a factor which is of 
critical importance) , dissemination policy will need either to expand 
the dissemination technical assistance capability or slow the rate of 
dissemination system* expansion. To achieve a balanced and appropriate 
growth rate, ongoing monitoring of the dissemination function will be 
essential. 



XV. ACQUISITION 



The weakness Of the dissemination/ linkage functions and their minimal 
impact on the user system become particularly evident from examination 
of tho acquisition process in the user system, and the problems faced- 
\>y user personnel in learning about and acquiring externally developed 
R6cD- outputs. 
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1, A' Virtually Non-Existent Function 

The ^acquisition function Is virtually non-existent In education as an 
Institutionaflzed activity. The purchasing specialty that one sees xn^- 
JLndustry is either totally lacking in education or (where it does exist) 
tends to be highly restricted in scope to little more than handling the 
paper work of purchase orders and invoices. Search, product evalua^tion * 
and assessment of bids are confined to purchases of conventional sup- 
iplles and equipment - - e.g.: paper, crayons, and chalk rather tha,n 
textbooks, new curricula, or instructional systems. 



2> Causes and Effects of Acquisition Weaknesses 




The ^^^m^KKj^^ of acquisition processes in education are a consequence of 
,two coillHjfpis: 

. !• The marketlng/distribution/dirfseminat ion/diffusion systems in 
education have been so inadequately developed, so diffuse' in 
structure .^and so uncoordinated, in channels that the educational 
marketplace is chaotic in nature. 

2. There is a general absence of specialized resources allocated 
to the acquisition function. ^ 

« \ ■ - 

A. Difficulties Facing User System P;ersonnel 

V 

Thus, user system personnel face great difficulty in learning about or 

evaluating the alternative programs ot products on the market to meet 

a given need*. ^ Tlj|re t^s no 'systematic mechanism to link potential 

users to available suppliers, or even to Inform the potential user 

about who these suppliers are or what programs or products they have 
to offer* 

Individual development organizations provide catalogues of their own outputs, 
bat there are few comprehensive guides. Even those few which were Intended 
_ to. e^royide comprehensive coverage of the outputs of a given set of in- 



^ stitotioriai ^^''^ or the outputs^ proceed under funding from specif ic'^gen 

• cies -^^^ or outputs oriented toward specif ic arenas of practioners"^' 

needs ^^^^ tend to provide less than complete coverage, or information 
u ''^^ ln*a, form less useful than needed.. 



B, Abstence of Evaluative' Infonnation, ^ * " * 

V Perhaps ^inost c'ritic^l of all, there are few gatekeeping quaTlty con- 

* • * trol mechanisms , to screen out weak innovations dnd th^e is little evia- 
Itiative informa^tion abou# available products'^ and practices . There have 
^ . » been spme recent inl^tiaitives to provide validity ^jifallty control mecha- 

nfsms o"n fhe. federal And state levels (e.g.: the ^ federal Joint Die - 

r ' . •:• ' ..; '■ ■ ' . •. • ■ ■'; ' . ■ / . 

seinlnat ion Review Panel established *^td^ validate Selected e'ducational 

R/.D&I outputs^ and state ptograms set up. to validate "exemplary prac- 

' * * . tices") . However,, these have been too limited to have significant Im- 

- J" ' v^' pacSit » in the absence of well established widely, used bases for rational' 

■■ _ , . . ■ ■ . ■• • ■ w • • 

/decision jtiaki^ng abqut whertier or not^fo replace- existing practices ot 

* ' . • . - ' ■ » * .■>.«.. 

materials wlthiptew products or R&D outputs , fad^ism has* been charac-"-^, 
r ^ ■ Jzei^Lsflc of schlpol system adoption of educational Innovation. Even 
where evaluative information ab(^ product is made available to . 

V/,;^ potential' ugers , validated profucts of this kin^ . are competing t/ith 

^ ■ ^ ' (74) . 

a large volume of nonvalidated product;s and practices. Thus, It 



' - is still difficult for the potential user, to makei a rational choice 

i. apbng alternatives. • • ^ iS / . " 

r ■ - ■'■ ■ . ' ' " ' 

'3." An NlgnRespohse^ " . • ' . ^ . 

NIE has ^recently, begun f uhdingr progratyis designed to provide unifc^^^ com- 
parativ^ evaluative inforraatiori'across the yhale. range of products and 
.pi^actices available tp meet a given need (e.g.: the^l976 Catalogue of tHE 
Education ^nr5tiuct:s ;*. the, product information packages aocess^-d In ERlfcT^ anH 
|E ' 8 ;^6i{sumer IrrE<>rmatio]g progt^am) . It -will- take some time* before we will 'be 



in apposition to assess whethar thi$:^;new strategy hasfrj^eg^^ in pro- v 

viding some ordeir to the educationai|^ti)idrketi)lace ^irtflj^^eded' supports for the 
acquisition function. : ■ ■ - /^.i ^ 4- 

■ •• ■ ' " ■ . - . ■ .':/',, ^ ^ . . ■ ■ ■ 

If this strategy is to have as much^?mt)aCt as po;^^ible j /the tdrget of the 
strategy within the usftr system, .Vill need to be parrowed., • At. present, the 
acquisitifion entry 'po lifts are GU^ttered throughoii^^^ t Jhe awareness, 

intere^, information search^' fete, tlj^at bring j^^^ey ^oduc^-^Qj^^gjiovation 
int.o this acquisition decision process may beg^ln .^^ teach^ifflH^^^hclpals, 

'ipurtlculum s^tlallsts^ the Superintendent pl^mi^Bi^^^^^^^ or even 

parents or community res-idents^ • virtu'^lt^ Its 

'environments This can be a source af strettgtJii^rior^^^^ function. 
At present, however, it is re^ti^vely; rare ^qia'^ktiybne responsible for 
IniClatlng.ahd carrying out acqUiqitionvaictdHV'itara^^^^^ major part of his 




Job.,, Thete fore the jjirocess Mmains.e^pl^ — not 

well :;int^grated into/flvstem f^cltlonitiagV toA^^i^ 



There is aug^estive evldenjtfe. that ;)bhe/mjM school districts may 

\, . ■ V. . Mf^ '%CV^V . ^ 

be those ^that are best 'lin|ced t#?fclfe, — either 

because^«o£- tte professftfh^^ th^- feacli^^ s or the leadership 

orientations and styfe o^^^ or the 

pr^tscnceYoi external cHang^/Sagent'^ ot^>e^eb^^^ of curriculum 

specia^iists oi^oorflln^tbrs on.^e staf£;^Iio devote time and attention 

to -d^teroiining what materials and {Products are avallabLe for acquisitioh. ' 

Therefore, initiatives td^lnijorov^ the efficiency and effectiveness of the 

acquisition function by pifpviding more and bet,te|j liiikages to the external 

r.ea9urce> system would appear to be a*potentially potent strategy. These 

linkages, could be devefloped either biy providing more specialized personnel 

responsible within ' the ^system* for* stimulating ajK^pfedi^inpiiing acquisition 

activities; Or by^pro^ding ij^teriajs or technical assistance 'personnel 

to provide this stl^latfori and coordination from outside the jystem, 



The latter strategy is at the c5re of NIE^s new Consumer , ^formation and 
R&D UtHizatioH programs.^ Together, they propose to: (1) provide^ tirgetted 
materials designed to inform practitioner^ about what existing theory and 
empirical reisearch suggest about specif l,c problem areas ;^ how this\relates 



to existing and exemplary praCcabpes; and wh|^t R&D p^toducts and programs are 
available to meet and (2) provide^'' technical assistance personnel 

to help schools select , "adapt* Install, and utilize available products and- / 

«• (83 89 91) 

prattlces to meet. their needs* * * . If these programs are effective 

and widespread In impact, the acquisition function will be strengthened and 

significant gains will have been made toward achieving the R/D&I system goal 

of Improving educational practice* At present, however, the-acqulsitlon function 

remains random and episodic, a^d Its Impact on school system functioning Is 

limited at best. ' - 

XVI. IMPLEMENTATION AND UTILIZATION V 



1. A Neglected Function ^ 

Implementatlon/utlllsa^on has been one of the least understood and nipst c* 
neglected of the R/D&I functional sp^ialti^s in educatioa diffi/sion iffesearch 

generally ended at the point addp'tion decifflMs w^jf^i^^^^^^^ sohool o|fiJlal8, 



thereby ignoring the Impl^mentatlon/utilizatxoh stages of Innovation* 



The study of implemtotation/utlllzation was spurred by the contradiction between 
fb'search resuLts tnPb showed high levels*. of Innovation as measu^H by adoption 
d^ecislons but low levels of innovat^bxf \dien^ classroom pract^Bfe Were observed. 
As researchers began ^to examine what happened to irinovations'after 'the ' 
adoption stage, t^y discovered/ ^at innovations were in fact not implemented 
at all; or were transformed during implementation ;intb "more of the same old 
thing"; or weijp, terminated as inef fective.withiti. only a few years. The 
failure of' innovations ttf survive the' installation aTh4 trial periods was 
^ traced to two rather. different kinds of .problems: 



1; on Jthe one hand, resist anc^^o the innovations by og^ating 

personnel because of attitudes, norms, and u3er system constraints; 



♦ Ji.-- an the ^pher hand, technicalt complexities and difficulties requiring 

'^^P^^'^lities beyond there of operating personnel (in. the absence if 
Implementation supports that were rarely provided) . ^^^^ ^^^^ 0 

2> The Knowledge B^se < 

■ * V 

There is an exO^hsive knowledge base about user system norms, values, and 
various kinds ^yionstraints that make teachers, principals, and other operating 
personnel re'sfW^certain kinds of ^novations ' ' ^25) ^^^^ 

is known about jthe technical problems and the kinds of i^em^ntation supj^orts 
needed to pyertome these problems — or how to identify potential technical 
pjpblems; assias user personnel capabilities in relation to these technical 
problems; andld^gn' training programs , technical assistance roles, and other 
required implenWation supports. However, there is suggestive evidence that 
the technical prob^^ms may be of far greatej: significance for determining the^ 
^ate of an innovation than attitudinal^roblems . More practice-basejl researc 



and 'systematic evaluaVion of implementation support strategics will^ be needefcv 
^to develop an adequil'e knowlWge base to permit efficient ^nd effective attack 
on the technical problems , of innovation impleTO^ 

3. Emergence of Linkage 0rRattizap.on8 "'^ . "sr /• 

• , . ^ ■ ■ , fg. _ ■ ■ ■ f ■• 

A number of types of linkage orga^iaiit ions supporting the implementation process 
have been emer^g in ttfe education sector in recent years. We would inclu^ie 
here: exte^5|^proups such as training organizations, technical assistance- 
groups and ::^^us:\^if of v^dicational consulting firms; ^Internal, organiza- 
tional 'unifciph|re^i^y exist (e.g.: a schopl-^i^^ict 'Ip^^chei^lirai^lib, ' 
op and renewal tVa^i etc.); and especially the state atK^^Iinterstate networks 
of school service orgaijizatlfens that have been promoted by rfcenf state and 
federal initiativUl.^^^^ 



The implemettatiort support Strategies used by cWse organization^ appear to lean 
mrf^-heayiiy tow#Vt a clinical change modal of working with- clients to adapt 
innovations to local circumstances — as contrasted wlt^i, the R&D-^^elivery 
model of assisting school iJ^feCisLct's ;^^4y:quiring standar«zed- product: 



suggesited by the liteirdture, we know very little about^^xkij^ h 

of this institutional base; how many organizations thietfe'^ tfreV*^^^^^^ 



developed by R&D organizations. However, beyond this jgetuir^l orientation 

of what' 

various types; how they are distribu^d geographicallj^nd by services \ 
provided; how mariyvschool districts they, serve; what strategies tm||| u^^' 
and with what* deg»JbV of effectiveness; 'what personnel bases, and other resources 
they draw on'; the nature of their linkages with gl^ as well as KU,. or; with ^ 
other' linkage ojtr^ajcij^zat ions; etc. 



»4." NIE 



jl^ .network^ 



XHe statpr and itaftfei^stpte . networks have been given increased visibility and some 

^rUfei^toetliate , s^acvice agencies nave been developed in 

\ ''.^^ ■ ' • ^ 

pme 6,tlfer .st^^|A deveippad implementation 

zamonal arrangements. Interstate networks 
J'^^f ..^;ri^^^ and districts 

innovative appiroaches (e.g. : 
%S flSi'*%&ti6tj^^ Schools; .and ''the RBS network of 

^Jidt:hpoi^ usirfe Prescribed Instruction) ./ The NIE R&D/Utilization 

Ji4^cf§ram d^^c^j^e^ Ijtfc^^e^^^ NIE^RFP will^ f und selected proejcts or^nized 
'"^ii^lntp fbur^4*°f^ ^ifajja^ehtlation supp^iift agencies: ; 




rptn J^i*. program and N: 
our .irtider^aadirig of the 
lm]i>l(^^tation/ utilizatJ 
17,J^|Pchool. districts 




lonitpfin^^rogram are likel)r to increase J 
tiorfal bases that . exist for conduct of the ^ W 
)art function; what proportion^ of the approximately 
Lti 'tfhis country are served l?y these .organizations ; 



\the^fctivit:ie5 that defiire this^ fiThc^tion in f:h^ educatign sector; ^and 

".• '. ■ ■ 

'perhaps alsp^ the* ^relative effectiveness of different implementation support 
strategies •'1* At present, there is little In the literature to provide a ci<aar 
picture of the natare and.extent of the implementation/iftilization support 

' ^ { ' ; 

function as it exists today in the education sector. * 



XVII. SUPPORT SERVICES 



1> Change's rin Support System Patteiras 



1^ 



As educational research and R&D activities' have expanded in scaled the *' 

- ' ^ ' ' ^ ' * ■ -^r^' '/^^ 

traditional research pattern .Ijf^he individual scholar working relatively 

y S , ' . • 

alone in his study or his laboratory has* been replaced by te£^ research 
■ under -complex organizational and inter-organizatiohal arrangements, 

suppp^ied Byi^ complex iiib sysjtem of mostly sector-spanning private 

■'cofp6ratipfts providing services, and supplying anc^fiiaintSining equipment. 



.1: 



Included in this suppG||rt, system are the traditioital research support 
servlce^j — tepje&rclij^ libraries and suppliers and maintainer^. of ^ 

the equipment used in t^e labbifS.tories.^/ifi^lso included, however , ara^uppllers 

■ '- '^ "# ' * war-' 

and maintaihers of the kinds of equipment^, and services that di^in^istl th^ 
newer, larger-scale research and R&D from the older, smaller-gcalie research 
and R6eD pattern — e.g.: compji^ter centers, data prdcessing^^servic^ 
bureaus, and computer maixitenance services; the suppliers ahd^aintainers 



of calculators, photocopiers-; typewriters and other of f ice^equipn^^t- and |||^ 
the various kinds: of ^ hardware that are becoming so prominent 

•in instructional* sys't^emndevelopmen the filin latforatoriies, jyideotape ^ 
editing facilities,, ca%ette reproduction laboratories^ and printing and 
publishi-ng facilities that pla/'such important suppor% roles in the 
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production of materials and complex multi-media inst^^ittjftri'al systems; 
survey researcfi^ service organizations that play a di^al^le both as R/D&I 
performers on projects of their own and as suppliers of support services 
for other R/D&I 6rganizations; and the various mechanisms a^4 arrangements 
that exist to p^tect proprietary fights' for R&D outputs thatr are not clearly 
in the public domain. Irtcluded too, especially fo^ the larger and more . 
complex projects, are secre.tarial and clerical! services, ^generally but not 
always provided internally. " , :■' . 



2, An Inadequate Knowledge Base for the Support Servicifc'^Function 

'is^ ' ■■ : • ■ ■ . ' ■■ ■ ■ 

"tJiere ir relatively little in the- publishied literature about the subordinate 

. • ' ■■■■■ .. ' . * ' • A - * ' 

systein of support services for educational R/D&I. We assume that there a 
great deal of information in the fit^f^, of federal agencies and R/D&f 



organizati9n8 that would be usefu 




^;assess±ng the scale, distribution. 



organizational capabilities, and clien^ ^service patterns of the varioujs 



support systems; the relative co3t 
external strategies for sui)plying 4; 
processing *or survey research unit 

organizational settings; and 
of procux^toent*- agWKmUitS^ that 
management 9k;t:at 
ease once the 
system for- eduq 





f the in-houil vs. 

services • (e.g. : data - ^ 
purposes' in different types 
[j^knesses of various kinds 
^pitf^upj^prt system 
er sectors Uiight be "acc^p^ Japped' with relatixi^s 
j^s.ions, and* service patternir o^^ttie support 
I ,,a*;e^cl^if i^ related to those coiite^tual • 



conditions that function «fiJ5trairits on the procurement and provision 
(^support services for the educational R/D&3|^ysteip. However, without 
sdeti basic information, we .^rp ru)t in a position to' attempt to transfer 
successful strategies f^^^^t|^er sectors to^hd ^||||ppir^--" 




It ion sector. 



XVIII. EVALUATION .RESEARCH 



1 . Historical Context 




<3 



Of all the^k/D&I functions -iri the education sector, evaluation resea 



ERIC 



5 



j$ti has 



a: 
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he /most rapid and 

* twelve'' yi3Ar8*f 



experienced the most rapid and extensive development in the^ last ten to 



Prior to the mid-'60s, evaluation of educational programs (when it was done 
at All) was carried out educational practitioners and by some researchers 



but rarely by people Who identifi^ themselves as evaluation research 
specialists. The approaches tended to be normative, but r^i^ely syst^patic or 
rigorous. ^ The predominant strai'dgy was casual .observation and analysi#* 
ConclusAns tended to be based on expert opinion, intuitr|on, and impression 
rather than sysliematically gathered and rigorously analyzed empitical data. 

This pattern changed significantly^ the ''l^bs as large-scale fed^V^^^ 
funded social programs prolifera^d, and t;fie legisliiilon that created them 
tended to require the systematic gathering, analysia, and r«s>orting of 
empirical data on program effectiveness. Thus, the evaluati^pn'^search , 
function expanded rapidly as a new specialty, even as a new iji^^try: in less 
, than a decade DHEW a^^ Department of Labor evaluation contractf'Uxpande^ 
'a $5 mil lion ^to a. nearly $50 millipa ^ndugtry. ^^^^ 1971 data/for DHEW evala- 
Ation contracts instate that 74% of theseVfunylsVeat^ to non-profit and 'for- . ^ 
profit research corporation^ and only 217^^o universities 017 utiiversity- 
a^iliated org^aj^zations :^^^^^ahy of; the/ research corporations are sector- 



V 



spanning Jfi^FtitiWions^ bi^^g on evaluation, contracts in education. Health, 



lOTTig on evajLuatiott, contracts in educatigr 
personnel ba$e developfflent|j|(gciaf we^^^^ the^ase of ^^e -of the 

more diversified research 'organizatiotis ^anc^gan^gement dfeisulting firms) ^ 
industry, defense'/ and aerospace as well. k 

"l^^ exjjansion and matu^^tiori if the evaltM^lpn research function in educatioiaC 
must be >fiewed as part' of this broa4|r cS^^ld the J^^i^iliJ <5f sb<Jial v ^ ^ 

program evaluation — showing the same ^f^eH^ 
evalbiators and amounts of evaluation activit^j; the same^^s^^^ 
of reWarcl:^ corporations competing ^^i^unxyerslties fpp*e\)r^iuation cont^^ 



and the ^^^^me^j^^dS of attention to methodolafg|cal, organizational, and^oli^fFa 
issues inherehtSin the ev^aluation role. 



2. Methodological Issues 

%■ - . ' :■ 

During the '60s and early '70s, there were- many heated debates among 

evaluation and research theorists about appropriate methodologies for the 

evaluation research function. One group 'argued that experimental (or ^ 

quasi-experimental) designs were more powerful than any other research 

approaches for as-sessing the ef fjectfivejv^^e of prog|r|^^|^ products, or 

strategies and that it was therefore essential tto< use these approaches to 

test R6cD outjputs and tb reform programs of all kinds .^^^H A second group argued 

that experimental approaches imposed unrealistic constraints on field settings 

and that at any rate it could nQver^vb^4>ossible to meet adequate!^ the 

statistical, design, and treatment^^H^int^^lons on which experimental approaches 

, , (53,. 135) 
are premised. • - 



Other methodological debates revolved around the.need^Eor evaluation approaches 
to provide feedback, tftoughout tike program develo^ent process — not singly 

telling the dQugloper at the end of the development process that his program - 

^1 (l^i)t 

did not work, but working, with him throughou4;^-the process to make it betterT- . 

Existing pre-post evaluation designs, made it cliff icult for program evaluators 
to provlAAthiS' kind of feedback, or tq|^||||derstand how to evaluate a program 
stimulus that kept chahgiijLg. * ^ ' . 

Some of these disagreethpnts have been eased by recognition among evaluation ^ 
researchers that there are a number of different kii^s of, evaluation serA 
each xexiulring somewhat differen-t approaches and techniques. The distinct ic 
^:J>e£^€n£i:|format and sunanative evaluations represents one such difference 
^lP|tially, the same researchers (fj^hducted both formative and summative 
evaluatiox;^, but over time there appears to have been some specialization of 
personnel and organizational units here. ^ 

. ■ ■ f*, V- ■ ^ ^. ■ ■ 

Ciirrently, the formatii^e evaluationis that axne undertaken as part of the R6eD 
pr pgr am/product deveIo|>meat process are generally carried out by evaluators 
who woirk with developers as part of the development team and pyovf^ ongoing 
feedback designed, to improve the product or program being developed. They u^e 
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both quantitative data*base<^f^nd qualJl^tatlve Judgmehtal approaches. Their ' 
style of functioning emphasizes flexlbl],ity — changing thrflr reso^ch 
questions, variables. Instruments, and approaches as the emerging prd|u:am 
takes shape and perhaps goes through a number of transformations. ^> 

The debate over experlmentaJL vs. other kinds of research designs Is now cent^Ved 
on summative evaluations the evaluations undertaken to test the effectlve- 

ness of a given program or product after it Has been fully developed. Summa- 
tive evaluations are usually done-^r an evaluation agency or organizational 
unit independent of the program' s .djpVelopers. Summative evaluations Include 
several types of evaluations differl4|ig somewhat i^^^ because pf^e J^t 

different information needs of the decision makers to whom they a^^^^j^essed: 



1. final operational, field tests of an RfiOl output to help the R/D&I 
^ manager determine whether or not it is ready for dissemin^Ltipn; 

' ' 2. ^evaluations of the ef fettlveness of a gj^yen program or productiftLn 
^^^^' W' '^-^-.v- ■ ^ given school or district in meeting locally defined objectly^Sj; 



3. evaluations of national program initiatives, sampling pr|^r&' 
components nationwide to Inform federal policymakers about the 
effectiveness of a given strategy for 'the relative effectiveness 
of alternative strategies) in mee||fag federally defined pclj^cy 
goals. 



\,There is fitilT^ some disagreement «^u£ how appropriate experimental designs 

\m3fii^ be for gjcoduct tests and ; for individual ^chool or s|jpool district 

P^lifc^on^ evaluations; and many other klndsiliif research desig;ns have been 

proposed for these type6 of evJaluat ions. Nonetheless, a federal program :^ 

. ... ' ., ■ ,0- 

evaluation policy (to whatever extent such a policy exlats) appears to be. 



moving toward experiSiental^approache^ increasing numbers of natlpnal 

program evaluations are being conducted using e M j ifc mental designs, control 
% groups, and some randomization of treatments. ^^^P^^However, the «.dlf ference 
^between experimental setting in the laboratory a^id_the field J^, gaining, ♦ 
recognition. Federal evaluators are increijibingiy ackncfl^HHH 




.0- ' ?.y . • 

supplement impatt; data with prdcess data>^emonstrat ing that a given ''treatment*' 

vas in fact implemented as* specified in the progr|pi design, and tjj^t the 

impact evaluation is a valid test of the program and not simpl^y a "non-event ^^^^ 

Otherwise/ questions can readily be raised as to whether a program evaluated 

aa,ji failure was in fact a f aljure^\^ - - sor whether instead J.t was rtevey 

even tried . (tad thus what was evaluated an!9\ judged a "failure" did not In 

reality even resenblo the specified program "treatment"), ^ 

3, Organizational and Political Dilemmas % 

A, The Evaluator's Role 

• ■ ■ /- 

, _ ,The eVipiluaJipr ' s role has come to be* understood primarily as <^ne of meeting 

■^':...;:/^'^'-y^-'':^-rrr''^'''' (134 lr35K 

the iniformation, needs of decision makers, * 7 . \How^i?er, there are 

a number of issues a^^d problems involved fn thys assumption. For example: 



ich decision m«ers are we talking about; ipiplementatiqn personnel? 
program manageifS at specific aites? progranfftadlanagers at the local, 
state and/or federal level? policy makers (and at what level)? 

• • ' ■ . . \ ..^ 

How.ilpes the evaluat&r deal with* the difficulty decision makers have 
in defining thelf infottoation needs; Hi agreeing on xdiat information 
is reldKrant or in agreeing on what, measurement procedures and 



inflitTa^ant^ are valid? 



# 



H 4|filW^. much input cap^ an evalua tor have in defining what he *inv^t^|ati^^|^v^^^ 
J: ^fust he accept |jp^v client ' s definitioja, of the program's obiect?i'v|is/3a^iid 

, simply assess|the ef feptiveness of the pjrpgram* in meeting jpnese 
# . objectives? Or "can he Include in'ihl?i ^evaluation considera\tion of 
the|appr^3;i^teness of objectives , (or the program's rationale 
or strategy) for meeting the ultimate goal of the program's developers?' 

' - B^^ >ThfeTPolitidal Di^lgmna , ' * 

• Evaltfations are often described as management tools designee! to provide 



- 270 ^ 



« "rational basis for decision making" - but decision makers in the 
public sector function in, a largely political sphere. This fact raltfes 
Importanc issues for the' evaluator on bolh theoretical and practical^* level 

On the theoretical level, we must .ask if 1^;^^^^^ 
"irrational," or If they are based onW^0acJ^nt^^ 
from the one generally used by social scientists . 



'■A 



On thevpr*ctical ievelj co€^^ the politics ot0 

decision* makings Generally speaking, progi|r&B are created by political 
.coalitions of diverse Interests interests which support programs 

tor diverse reasons. These coalitions tend to view negative evaluation 
Hresearch findings unfavorably ^^^jnd generally have enough influence 
to modify or bury negative findings and keep their ^ograms going 
regardless of^irtiat ©valuators reporty Conversely (yet similarly), 
programs may be opposed by other polit^.cal Interest ^rp^ps — interest 
groups who will use findings of evaluation research^tb achieve their 
ends. Thus, evaluatfon research/ findings may be used, mlsu«|||| modified, 
"^WJ^-^^5!*^^^ etc^^^V 1^5^ — in other words, used as 

a "political football". Given the pipltical context and the methodological 
Issues w# have noted abovfe. It Is not surprising that controversy over ' ^ ' 
^egatlve evaluation research findings^ are so often phrased In terms of 
liethodologlcal Issues rather than jayaljuatlon findings per se, - 



C. The "Value" DlJLemma 




/ 



The educational context is value-laden, and'valjjwi cK&*treS''fent»r<^ 
every one of the key decisions made by the evaluator. ^ The outcome of 
evaluation research may be p^detfermlned by the*cholce of rclliBarch questions 
and objectives^ the criteria '^ged In judging effectiveness, or the measure- 
ment Instruments administered. Trom the human perspective, the question 
must be asked: Is the ilfplyator value-free whep doing evaluation research? 
From the organizational/political context^ perspective ^ the-question must 
be asked: To what extent ls/shliuld;,thesej^key declslorf* choices of 

the evaluator be Influenq^d by -^e* <>rgOT^^ of the * 
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decision maker oh the one hand, and the political context/dynamics on the 
other hand? . : 

p. Current Trends 

Evaluators are developing an increasing sensitivity to the ^oliticis of 
decision making. The evaluation research literature has shovm the 
progress made by the field pver time in coping with this ^^^^ation 
from Mti early lltaaratSfte that simply bemoaned this situatfW^ tfe-more 
recent writings that accept it as a given and build consideration of 
the politics of decision making into the planning and implemen^Vation of 
evaluations to make them inoret "strategically useful ".^ (75, 



The evaluattfira research fOttction ts^ in a much stronger organisational ^ 

and' political position now than It was a decade ago. ttiSte^d of being 

located in marginal units that could be easily ignored, planning and 

evaluation units and their administrators are now included in the top ^ ^ 

■■■ ■ ■ ' (43): . ^, ... . - . 

management decision structures of federal agencies. The evalua- 

• , y • . 

tion research function is taking on increasing prominence in the 

' (131) 
General Accounting Office's audit;lng activities. On the state % 

level, legislative oversight committees with strong evaluation research 

- 1 m :^ • ^. 

staffa of their x>wn have^^^^^ significant visibjy.ity to evaluation 

il (80) \ 

tesear'Ch activities and fiMings. \ ' 




^ 4. The Impact of Evaluation Research In the Education Sector 

There is stiU subs t ant ial>S is agreement over just how much impact the 
evaluation research function has „had (or can haye^ — but clearly^ . 
there is re^^aj^Jj^yM^S^^^^tl^ of extensive use of evaluation 

research f inrfirt9*<%a^]^^ of polic>^ decisions. Equally clearly^ 

^ evaludtions *have^been pro4uced and even tt^ 

^be¥i^e^^^ from serious methodological flaws. TRe 

field of evaluatlon'^^esearch lacks an adequate theoretical base, and is e\j 
more tacking in adequate instrumentation. Thelre is no clear federal 
evaluation research policjr, and federal agencies have not even xssued 
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guldelineftt^a^ to what constitutes an adewpi^ oi^^^^ evaluation. 
, (05, tfipagh, Mb been moving in' this dli^^ta^ beyond for the evaluatioi|, 

of ESEA Title I programs)/^** wj,^^^^^^^^^ would iJfeem, then, that the 

cvaluatiort research function in the f(ld€gcally funded social program field 
r/BmainjS weak In comparison to the evaloadraci r^earch function in mature 
R/D&I systems* 




XIX, RESEARCH ON R/D&I 



1. Availability of Analysis and Empirical Research 
Given the relatively brief history of educational R^&ife- 

astonishingly large accumulation of analyses and empiricm/ iCHi^searoh on the ^ 
fun<||ionlng of the system. This is attributable in pa gBpa^ 4,bfe negative 
politidal climate in which the syst'em functjteis — nppI^Ack of confidence 
In Congress and various federal agencies In the educa^ioukl enterprise v Su 

As noted earlier, there has been a tendency, to pull the system out by its roots 
evsry couple^f years' to see how well it is growing and to determine how its**. . 

•fflbtiveness might be improved. A large number of these analyses were conducted 

. ' . ^Jfe ^ ^ (36/105, 107, 117, 130). 

^ by or for federal agencies or Cdlfressional committees. 

^ / ■ ^ ' ^ - 

^*f^ A second factor of some Importance in accounting for the large ikimber of 

jt * ' . . ■ ' 

^ analyses was the increasing, self -consciousness of the* social sciences In the . 

late 'eOs as to their proper role in relation to 'governmental agencies and the ' 

:>^.T*I^ ^^^^li^iatipa of Si>cial science knowledge* Stjme of the Xf^vsint j^Lterature was 

provided by ^udy commlttfees of the National Academy of Sciences - National Research. 

Council; the Natiotial Science Board; the National Academy of Education; and' 

the President »JL Science Advisory Committee » ^^ '^ » 



_j|^Scierice Advisory Comipit tee , 



Some of .the ^i^varit literature is traqeable to an international stimulus — , 
Q' i^eque3t^;^f^^ Orgttttzation fol*Economic Cooperatfion and Development (OECD) 
^^wP%^^ P^^^^^^P^^^ ^ cross-ijfational review of feducatipnal R&D and an' 
analyslA of how«6cD might be strengthened to increase its potential for 
improving educa,^ional practice. ^ 
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Some of the more recent literature is the result of the emergence gf know- 
ledge production/utilization as a new research area in the educational research 

■ ■ ^ ' (1?3) ^' 
community. ^ . » ' 

But . probably the most important impetus of ^alj. iiji recent years has come from 
the sponsors of educational R/D&l/(not only OE and NlE but also private 
foundations sifch as Russell ^a^e) — e.g.: their increasing interest in • 
evaluation research as a basis .for policy formation; n their in? tiatives 
to support the design,, develop^nt, and utilization of routinely collected data 

bases for monitoring the progress of the educational KPU system, detecting 

V , ' . . (37 .71 92 95 122) 

problems, and determining the impact of policy " initiatives. ' ^V. ' ' 

ft " ■ ^ ■ V 

' t .... 

2. Types of Studies in the Literature . . ' 

The literature can be categorized into five types' of studies: 

■■ ■ - "... , • • r 

1. distillations of expert analysis and opinion; ' 

^ ' ' ■ *^ * ^ 

|2. systematic empirical evaluations of particular components or 
r ' , outputs of- the educational* R/D&I system; 

3. synthiBses of the relevant literature; * * 

'. . •« ... .-. .. - , -.J 

.4. case studies of exemplary educational R/D&I projects; and 

' : ' * ■ $^ . ■ ■ " , ■ .\ 

' descriptions of the KPU data base and monitoring system that Is ^ . 
> being developed -under NIK auspices « 

Most of the relevant literature (and virtually all of it that was produced 

ting the first five r i : years of the federally funded system's history) 
Is Into the. "distilla on of ekpert analysis and opinion" category. These 
analyses were generally based on inteirview^; site visits; examination of 

materials in agency files; perusal of system outputs; or the Insight of scholar 

" ^ ' . ^ . ' (2, 3, 14, 15, 16) 

working together to form judgments and make recommendations • . ,^ ; 




iinplxicarl~xn^rest±gatlona7irtake33p^he-aecond- — 

' ' / * (124) ^ • • 

evaluations of personnel training progtai^s; or ERIC information ^ 

products ^^^^ or pilot state '/isseminatiorf projects; 127, 129, 141) 

or AERA meetings and journal publications* as^critical. elements in the KP infor- 

* : ' - (99 101) 

mation floW systiein ±xi education;^ * , etc. , 

We include here especially several studies of the ev^liption research fui^ction 
how it is , organized; who doe^ what kinds of evaluations with what degree •irjf 
effectiveness; nhow evaluation find^ings a^e> us^d; etc,^^' ^' The "repearch- 

Qn-*research" character of /the^e studies of the evatluation' restearch funotlQCi 
suggests a particularly l^igh ].evel of self-awareness within this function/ 



here are relatively f ew documents in the other three cat^egorles. The' literature 
that is available. clearly reflects the Inst i^tijuionalization of "research~on~ 
resea^h" in ^duc^atlpnal R/D&t', \ e£forts to synthesize' the existing lit era- 
ture;^^^' efforts'to map .the domain of educational 'R/D&I; "'"'''^^ 

arid descriptions c5f NIE's KPU monitoring project designed to: develop a data v 
base on educational KPU functioning; use Hhe data base t^P^uild. models of the.^'^;^*^' 
dyilamics of KP^^ functioning in education; and monitor KPU functioning to' . 

identify ' problems requiring* n^w policy initiatives or to assess! the effects of < 

/ J ■ (92 ^ 95) * ■ ' \ ■ . ' " ; 

existing policies and policy (manges. ' * . ' V ^ / ' 

At present, i the research, literature on educatiotial ,R/D&I .functioning touches ---^ 
on only limited ar^as of system functioning^ provides relatively little ' 
empirical data; is atheoretldal; and appears to be only .minimally utilized 
by eit^iier sponsors or performers of R/P^^I activity. How^^r,, ali of this may • 
change if the NIE monijtgring project is efj^ective in institutiohalizing research 
on^the educational R/D&I system, and providing the kind of data base atid pollS^ 
analyses suggested in current project descriptions. 

XX. CONCLUSION '. « " •• ' ,^ " 

'We have throughout 'this* report no ted^* weaknesses in the educational R/D&I , 
•system. It 1^ important now to re-emphasize that we have also noted that 
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what we have found -would be generally what one would expect to have found 
within a relatively ;young R/D&I system. There has been progress, and 
thQre are aignd of the beginnings of a transition from the introductory 
Stages of system developme^nt • V 

/ . ' . ■ v ■ ■ . ,■ 

ThuSy as we not^d at the outset » the current state of the educational 
,.R/D&I system mdst be assessed in ^erms«of where it has been arid where it 
now has the i)otential to go - - ^ot in terms of unrealistic' expectations 

about * "progress and output to date", 

••/' • ■ ■ 

/ ' ^ ' ■ . 

WitTi this perspective, in mind, we can see the last two decades as a period 
of some iinp^t^at^t achievements in the creating and building of the educa- 
tional R/D&I system in the United States, As' compared to twenty years ago: 

If, There are to^dy sOm^"*" 1500-3000 organizations (academic, private, 
and public) whicliQ have R/D&I capacity - mo^tL of this capacity 



being relatively new and being-^largely the result oF^edetal 
funding, . , , ^ 

2, .The personnel base has, doubled (perhaps tripled) - - from 

\ ' around 4000' in 1969 to 8-12,000 i6 1974, Most of this work <orce 
Is represented by research and (development personnel, 

3, "The edii^ational.^R/D&I system has produced a Substantial. number 
^of outputs* Some of these, have been putstandii^. quality and of ^ 

a widely reported excellence - -^^ro^ucts fro^ .R&D organizations 
^ and es^emplary products which have been identified^ generalized 

, • arid widely disseminated, ..... 

■". ■ * " ■ * ' 

Some, linkag&s have been developed between 'some of ^ the strong 
,develQpment Organizations ^nd the sphool systems x^ho have be^n 
*using their products, - 
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5. Since some degree of maturity of a knowledge/ techno logy base 

is necessaiv to allow its codification into handbooks and other 

. , ^ syntheses^, w^ may infer sp«^ beginnings of educational R/DSI 

A * system maturity from thi increasing level of availability of 

such nkndbooks/syntheses. ^ .• ^ 

« ' • ■ ■ 

. • ^ . • , • - ■ . 

As the R/D&I sy^tiem has matured, inevitably s6me of the functions have , 

developed and/or^ been supported more than others. It wilL be important 

to maintain a "i^^^ance" between these, various functions of the educational 

R/D&I system. I^isV^alance must take into account for each function ; 

1. !^ thS time -period needed to produce significant outputs; - ^ 

2. the Impact each function has on the other functions; 

ji '3. the> level of funding needed lioth to .maintain a balance and to 

maintain the basic integrity of the persomiel and institutional 
base within each function. > 

• 4. what currently does/does not exist within each function (in 

"terms of outputs and of the institutional personnel, know- 

' * . • - . - 

ledge and technology bases) . 

' ' • • <, ■ . , 

In stinnnary , the perldd of the <last two decades* has been an Important era 

* • ■ ' ' * 

of initial system building for the educational ^/D&I system."^ There remain 
pjoblems^ weaknesses , critical gaps to be filled, balances^' to be^achieved 
^ t^^- as ohe woyld expect to ''Ind in a relatively young1^R/D&I system.' 
These ideutif led ne^ds become ihe focus for system building and rebuilding 
tor the next transitional phase for the next five to ten years. , In this 
period, it will ne vital to provide continuity, stability and security in ^ 
order that the ^up^tional R/D&I system can take root, grow 'and \deve lop*. ' 
miaturity. Only in these wa^s.can we hope to. develop a <maturing Mue^tional 
.R/^£cI system, i^hrich can have signiJEicant impact on the educational, system 
,irt the United States. ^ ' . • 



^ 277 - 



REFERENCES 



1.. 



N 



Abeft, James G.^ "Cos^t and Cbst-Ef fcQtiveness Paper delivered 
at International Federation of Operational Research Societies " 
International Cojst-Ef fectlv^nesS Conference. Washington: ^Aprll 
1971, unpublished* As adapted and cited In i^bert D. Blderman 
and Laute M- Sh^irp. The Competitive Evaluation Research Industry . 
Washli^gtpn: Bureau of Social' Sclenc^^ Researqh, Inc. , 1972. 



Bailey, Stephen K. "A. Final Report from the Nat;4.onal Advlso^ry . 
Committee on Educational Laboratories." Educational Researcher 
(newsletter). Vol. 21, September 1970. 



3. Bailey, Stephert K. "Sljllilflc^nce of the Federal Investment* in . 
'S^ . Educ^^tlohal R & D." Journal of Research and Development* in 

Education. ^ Vol. 2, Summer J969. 

. . . ' ; > 

4. Baldrldge, J. Victor. "Political and Structural Protection of 

, Educ^ion^l Innovations," in' What Do Research^ Findings Say About 

iSet ting Innovations into Schools? A Symposium . Philadelphia: 
* Research for Better Schools, 1974. 



Baten^^h, Richard et al . A ProjecteitrRole for Marketing in the 
Disseminatibn of Products Developed by R&D Agencies .^ Paper 
presented at the Annual Meeting o£ the American Educational 
Research Association, 1973. * 



6. Bideri]aan, Albert D. aiid Laure M. jpharp. The Competitive Evalu- 
ation, Research Industry .. Washington: Bureau of Social Science 



•Researiph , Inc . , 19 72 . 




ERIC 




ERIC 



- - 278 - I 

It . ; • , : ' , 

% 7. Borg, Walter R.\ "the Balance Between Research and Development." * 
Edy^atldnal Technology , Vol. 6, No. 7, 1969. Repr0ted in 
^ Educational Development,; A New Discipline for Self-Reneval . ^ 
John HeAphill and Fred S. Rosenau, ed. Berkeley: Far West 
Laboratory for Educational Research and Development, and Eugene: . 
Center for the Advanced Study of Educational Administration, 1973. 

•. \ . • ,„•'■. ^ ■ 

8^ Brim, Orville^B. Knowledge into Action: Improving the Nation' s 
Use of the Social Science^ . Report of the Special Cc^nifnission on 
the Social Scl^^c^s of *the National Science Board. Washington: 
National Science Board, 1969. . 

'9. Bureau of Social Science Research. Survey of School Practices. 

Washington: BSSR, 1969. . ' . / 

10, Campbell, -Donald T. "Reforms as Experiments." American', Psycholo- 
gist , Vol. 24, No. 4, April 1969. 



4 V . 



11. Cafo, Francis. G., ed. Reading's in Evaluation Research . New York- 
Russell Sage Foundation, 1971. 

12. Carroll, John B. and Patrick Suppes. "The Committee "on Basic • * 
Research in Edui&atio^: A Four-Year Tryout of Basic Science Fundi^ig 
JProcedures'J" Educational Reseaircher . Vol. 3, No. 2^ February 1974. 

13. Charters, W. W. , Jr. and John E. Jones. "On the Risk of Apt)raising 
Non-Events in Progtam Evaluation.". Educational Researcher . Vol. 2, 

-\ N6. 11, November 1973. 

■> s ' ■ ' ■ ' ■ ' ■ 

14. ; Chase, Francis S. "Education R &'D: Promise Or Mirage?" Journal . 

:of Research ^nd Development in Education . Vol. 1, No- 4, Summer . 
I 1968. ' ' p / ' • ' 

• M ' - ■ - . ^ • .• . ' ; 



• 15. 



Chase, Francis S. "T^ Laboratories: 1970 and Beyond." Journal of 
•Research and Development In Educatldn . Vol. IJ No. At September 
1968. ■ ■ 



16. 



17. 



V 



Chase, Francis S. The National Progtan^ of Educatlonai Laboratories. . 
Washington: Offlcfe of Education, 196iB."^ . f • 

Chorness, N. H. and C. H. Rlttenhouse. Decision Procjesses and 
Information Needs in Education: (k Field Survey. Mehlo Park: 

; f ^ ■ ' 

Stanford Research Institute, 196B. 



18, 



qhurchlll, Stacey. Modelling a National Educatlonai 



A Conceptual Framework , .Washington: National Institute df 
Education, 1974. ' ^ 



19, 



lark, David L. and John £. Hopkins/ A Report on EducatlbngT "^ 



Research, Development and Diffusion Mjtefpoweri 



20. 



idlana University Research Founciatlon, 1969 
COBRE . Jlnal Report of tfie Connnlttee on Bas 



R & p System: 



,1964-1974 . Bfoomlngtonj 



Ic^'Research In 



Education. Washington: Division of Behavior 



Academy of Sciences — National Re^saarch* Council, 1972. 

21. Cohen, David K. "Polltiyk and Research: ^valuation o^oclal 
Action Programs In Education." Review of Ecjucatlonal Res^^ch . 



al Sciences, National 



Vol. 40, 1970. 



22. 



23. . 



.Cohen, David K. and Mlchadl. S. Caret. "Refdrmlng Educational 
"policy with Applifed Rese>^rch."- Harvard Educational Reviejw . Vol. 45, 
No. 1, f>ebruary^l975. . . 

Connhittee for EconDm4.c Development. Innovation In Education: New 

■ *" n~" — ~^ r 

Directions for the American School . New Yoi^k; CED, 1968. 



ERIC 



-V 280 - 



24. Committee for Econorald Development. Tfie Schools an4 the ChallenRe 



of Innovation . New York: McGraw-Hill, 1969. 



✓ 



25. -Xo twin, Ronald G. Beyon4 Bureaucracy In Educational Research 

C ^ ~y — { 

, Management . Paper presented, at Mid-Year Meeting of the Special ^ 

^ Interest Group on Research. Man/igement of thie Amferlcan' Educational 

. Research Association, November 1973. Reprinted In The Generator 

(Division G AERA Newsletter), Vol. 5, No. 2, Winter 1975* 

26. Porwln, Ronald G., VAtllard Lane,, and William Monahan. Foundations 
of Administration In Educa^on; The Behavioral Setting . New York: 
>IacmlUan, 1967. \^ ^' ~ 

27. Cprwln, Ronald G. "Social Organization of Schools: School as 

JBL formal Or<ganlzatlon, " Encyclopedia' of Education ^ New York: (^^^ 
Macmi^lan,* 1971. . 

28. Corwin, Ronald G. and Saad Z. Nagi. "The Case of Educational 
Research," in The Social Contexts of Research' . Saad Z. Nagi 
^n^ Ronald G. Corwii^ eds. New York: Wiley, 1972.- i 

29. Coulsbn, John M. Toward Establishing an Educational Information ' 
Dissemination Center . Washington: NIE^ 1972. • ^ ^ 

30. Council for Educational Development and Research. CEDaR Catalog ^ ' 
o^ Selected Educational Research and Development P-ro^rams and 
B^a^ducts . /Denver! CEDaR, ^72^^ - . ^ 

K ' • v., " K 

31. Council of Great City Schools. PMIS Prbjegt. Plannrlng and Manage - 
' ment Information System. A Project to Develop a Data Prodesslng 

System fox Support of the Planning and Management N^eds of Local 
School Districts > Final Report . ■ Washington: Cpuncil of Great 
* City Schools, 




\ 



- 281 - 



♦ "32. Crane, Diana, ji'tnf ormation Needs and Uses,'* in ^nnual Review of 
Information Science and- Technology , Vol. 6.v C. A. Cuadra and 
A. W. Luke, eds. Chicago: Encyclopedia B|||^tannica, Inq. , 1971* 

33. Crane, Diaria. Invisible College; Diffusion of Knowledge in . 
Scientific Communities .. Chicago: University of Chicago Press, 
1972". \ ' ' / ^ 

34. Cronbadh, Lee J. and Patrick Suppes,^ eds. Research for* Tomorrow's 
Schools: PlscipHiied Inquiry for Education . Report of the Committee 
on B'ducational Research of the National Academy of Education. 

New York: Macmillan* 1969. " * ' 

- ■ ' # > 

-? ► > 

35. Del Schalock, H. , Gregory P. Thomas, Keven A. Morse, Clark A. Smith, 

and Harry L. Ammerman. The Oregon Studies in Educational Research ,. 
# 

Development, Diffusion, and Evaluation. Voj.*^: Summary Repdrt> 
* Monmouth, Oregon: Teaching Research, OregoffState System of Higher 
Education, 1972. , \ • ' . 

36. Department of Health, Education, and' Welfare./ Reyiew o£ Planning 
^ and Programs of the Bureau of Research . Washington: DHEW, 1968. 

37. Department of Health, Education, and Welfare. Toward a Social 
Report s Washin^on: Government Printirvg Office, 1969. 

38. Dershimer, Richard, efd. The Educat^lonal Research Community; Its 
Commufiicatjon and Social Structure . Washington: American Educational 
Research Association,*, 1970. . 

39. Dershimer, Richard A. The Federal Government and Educational R&D . 
Lexington, Mass.:^ Lexington Books, 1976. 



- 282 • 



40. Dissemination Analysis Group, Dissemination Policy Council. 
Educational Dissemination in Relation to Public Elementary and 
and Secondary Schools. Prelimiftary Final Report , Washington: 
Dissemination Policy ^Council, September 30, 1976. 

41. Educational Products Information Exchange.. \ * 

42. Educational Testing Service, in Collaboration with the Education 
Commission of the States. State Educational Assessment Programs . 

' Princeton: ETS, 1973. ^ 

A3.. Ev^ns, John W. "Evaluating Ediicatlon Programs — Are We Getting 
^ Anywhere?" Educational Researcher . Vol. 3, No. 8, September 1974. 



ERIC 



\, 44. Flncher, Cameron. "COBRE and the Dilemmasvaf Basic Resear^ch In ^ 
Education." Educational Researcher . Vol. 3, No.. 2, February 1974. 

45 Freeman., Howard E. and Ilene N. Bernstein. Academic and Entre- 
neurlal Research; The Consequences of Diversity in Federal 

Evaluation Studies . N^w York: Russell Sage Foundation, 1975. 

? . ' ' 

46. Fry, Bernard M. Evaluatiorf'^udy of . ERIC Products and Services . 
Bloomington: Indiana University, 1972. 

47. .Gage, N. L. Handbook of Research on Teaching ". Chicago: Rand 
McNally, 1963. 

f 

48. Gideonse, Hendrik D. Elements of National Science Policy: A 
Perspective from the Behavioral and Social Sciences . Paper sub- 

. mitted to the Subcommitt.ee on Science, Rersearch and Djevelopment, 

> Committee en Scl^tet^nd Astronautics, U.S. House of Representatives, 

September 11, l^^^^Keprinted in The Orej^on Studies in .Educational 
^ Research,. Deyelopmertt, .Diffusion, and Evaluation. Vol. II: The 



• 283 - 



Literature of Educational RDD&E , Bctte C. Porter, cd. Monmouth, 
Oregon.: Teaching Research, Oregon State System of Higher Educntloq, 
1972. ' 

49. Gldeoase, Hendrlk D. •'The OECD Policy Review of U. S. Educational 
R&D.** Educa'tjpnal Researcher (newletter). Vol. 21, April, 1970. 

50. Gldeonse, Hendjrlk D. ••Research and Development In Education: A 
Market ModelV In The Oregon Studies Iti Educational Research , • 
Development, Dlf fusldr/, and Evaluation. Vol. Ill: Conceptual 
Frameworks for Viewing Educational RDD&E . H. Del Schalock and 

G. Roger Sell, eds. Monmputh, Oregon: Teaching Research, Oregon 
State System of Higher Education, 1972. 

51. Goodlad, J6hn I. et al . Looking Behind £he' Classroom Door . . 
Woi:thington, Ohio: C.A. Jones, 1970. 

»■ * * „. , 

52. Gross, Neal C, Joseph Glacqulnta, and Marilyn Bernstein. Imple - 
menting Organizational Innovations: A Sociological Analysis of 
Planned Educational Change l^ew York: Basic Books, 1971. • 

' 53. Guba, Egon G. •'Development, Diffusion and Evaluation," in 

' ^' 

Knowledge Production and Utilization in Educational Administration . 
. T. li* Eldell and J. M. Kltchel, eds. Eugene, Oregon: Center|€or 
^he Advanced Study of Educational AdministratioR, 1968. 

% ^ ♦ 

"54. Guba, Egoh G. The Place of Educational Research in Educational 

Change . Address -to the Canadian Council for Research in Educatfon, ^ 
1967. Reprinted in The Oregon Studies in EducationaT^esearch , 
^^^^^ Development, Diffusion and Evaluation. Vol. . II: The Literature of 

Educational RDD&E . Bette C. Porter, ed. Monmouth, Oregon: .Teaching 
Research, Oregon State System of Higher Education, 1972. 



EKLC 



55* Havolock, RonajLd, A Corepnrattve Study of the Literature on Dla > * 
acmijigX iojL^ll of Sclcntl^flc KnowleWK" * Aim Arbor: 

Center Research on the Utirizatian o€ Scientific Knowledge, 
InstlcuCe for Social R«?»earch, Univeratty of Michigan, 1968. 

561 Havelock» Ronald and Mary Have lock. Educational Irtpov ation in 

^ Afik ' — 

jyie^^iixei.Sta^ Ann Arbor: Center jE6r -Research on the 
Utilization^ of Sciaptific Knowledge, Institute for Social Research/ 
University orMichigan». 1973. 

57. ' Havelock, Ronald G. "Locals Say Innovation is Local: A National 

Sur'^ey <>f Sfihoox superintendents. " VWhat Do Research Findings Say 
About Cg^t^'^^ Innn yation into School^; ' A Symposium . Sanford ^ , 
T^mkin Mary y. Brown, eds. Philadelphia: Research for Better 
Vi • SchoolB, 1974. • • 

58. Havelock, Ro^ald^^^c- f A.Cuskin, M. Frohman, M. Havelock, Hill, 
' and J. Huber. Piagninft for Innovation jihrough Dissemination and 

tjtjjj^t iglL-Qf j<nn wledge . Ann Arbor: Center for Research on the 
Utilization of Scientific Knowledge, Institute for Social Research, 
University of Michigan » 1969. ^ 

59. Hemphill' John "Educational Developnient. " ^Urban Review 

Vol. Af No- '2, October 1969. Reprinted in Educational Development : 
^ k ^^^j^iscislln^^f ot Self-Renewal . John K. Hemphill and Ft^d S. 
RosenaUf eds. Berke*ley: Far WesX Laboratory tor E?ucati9nal 
•Research and Developin^nt , and Eugene, Oregotir Centet for the Ad- 
, ^ vanced Study of Educational Adnrinistration, 1973,^ 

60. Hemphill» John and Fred S. Rosenau. Educational Development : 

: ^ A New^js^jjllne^^f oT Self -Renewal . Berkeley: ^ Far West Laboratory 

for Educstional'vi^egcarch and Development and Eugene: Center for the 
Advanced Study of Educational Administration,' 1973. 



Joe 



ERIC 



r- 



^^-^61/ Hobbg, Daryl. ^. "Faci^^^ Process in Education. '■' ' 

.; - Prqsir'gm Deyeiopmerit agd Research . Columbiis : Center for Vi^catioral- 
- .. and' Techjiical 1^ Reprinted in 

• . .' ^" Educational Research, Development. Diffusion, 

• V'^'^aiapfev^ XI: , The" Literature of Educational R DD&eI 

/ />f ?^.*^*^f ■9'- ..^°'^':"'^d- Monmouth » Oregon: Teaching Research, Oregon 
.Stystem of Higher Education, 1972. 



6?. Hood, Paul»^D» Dissemination. Distribution^ and Utilization, of 
Laboratory Produ'cts . Berkeley: -Far West Laboratory for Educa- 
* tlonal Research" and Develppment, 1970. Reprinted in Educational 
Development: A New Discipline for Self-Renewal . John K. Hemphill 
- and Fred §;j^^senau, eds. ' Berkeley: Far West Laboratory for ( 
Educational' Research an# Development , and Eugene, Oregbn: Center 
for the Advanced Study bf Educational Administration, 1973 

.■ ' ■ • " ''/\ -V ■ ■ >. - ■ 

63. Hopkins , , John E. An Updating of the' ClarTc-Hopklns. Manpower 
• Prp.jecttons : AEjRA ik^ k Force Technical ^aper. No . *25 . Washington: 

American Educational Research Asisoclatlon, 1971. 

■ ■■ ■ .-. % " ■ ^ ■ . ' ■■ 

64.. Horst, D. P., G. K. Tallmadge; and C. T.-Woodl A Practical^ Guide 

to Measuring Projec t Infract on Student. Achievement . Washington; 

Government Printing Office, 19*75. ' 

65. Interstate Pro jecrt on pis^semjnatlon. Report and RfecommendatlohsV 
' IPOD, 1976. ■ ■ ■ ■ ' ■ . t ; ' . ■ 

66. Jones, Wlllard G.* "The Nature and Process of Educational De^lop- 
"^"•^ • " . The Nature 'and Process of Educational Development. An 
Operation al flodei, Pa-rt II . . Greeley. Colorado: Rocky Mountain 
Educatloijal Laboratory, 1969. Repi;fhted in The Oregon Studies in 
Education al Re seax<ih. Development. Diffusion, and Evaluation . Vol". 
II:. The Literature of Educational RDD& E. Bette C. Porter, ed. 

; Montitouth, Oregon: Teaching Research, Oregon State System of Higher 
'Education, 1972. \ 




^ 67. : Katagiri, George. Oregon' s -Pilot Stat:e Dissemin ation Program: Final 
\ • ' Report . Salem: Oregon State, DepajtmeAt "of Education, 1973, 



\/ ; 68. ^*e« linger, Fred N., ed. Reviefw- o'f Research in Educatiotf; Volume I , 
^ ' / iMsca* Illinois: *F. E. Peacock, 1973^ V 

' ' # • • ■ . • [ ' . . : \ • ' ■ ....H- 

69- Kerlinger, Fred N., ed. . Review of Research in Education: Volume III . 
jfc ^' Itasca, Illinois: F. E. 'P.eacock, 1975% ■ ■ , - • 

70. Kerlinger, Tred N. and John B. Carroll, eds,. Review of Research 
In Education: Vol. VII . Itasca, Illinois: F. E. Peacock, 1974. 



71. Land, D. and S* Splllerman^ eds.^ f Social Indicator Models .^ New 
% . York: Russell Sage Foundation, 1975. ' 

72. Levieh, Roger E. Rational Institute of Education:^ Preliminary 
Plan for the Proposed >£^stitute . Washington: Rand Corporation, 1970. 

73. LindemaAi J.v S* jBailey, J. S. Berke, and L. ^1i../liaum. Some 
.-Aa pects of Educational Research and* Development in the; United , 

^ -States-r-Report for the OECD Review . Syracuse: Syracuse University 
Research CSrporatioh, 1968. 

: ■ * ■ , , ' ■ ; ■ ' ' ' ■ ^ 

74. Lippitt, Ronald.* "T^e Use of Social Research to Improve Social/^ 

- Practice." American Journal of Orthopsychiatry . Vol..\35, July 1965:> 

^^S^^"^^'' ^^^^^^^ iii The Oregon Studies In EducatioLnal Research, Developmenit^ ' 

Diffusion, and Evaluation. Vol. II: The -Literature ^ f Educ^ttional 
V RDD&E * ^Bette C. Porter, ed. Monmouth, Oregon: TeaOTLng Research, 

Oregon State Systeiti of Higher Education, ^972. '-^ 

75. tynn, fcauBence E., Jr. "A Federal Evaluation Office?" Evaluation . 
Vol. 1, Ko. 2, 1973. 



ERIC 



- 287 - 



"76.. Ma^ffon, Ward S, and Bruce Craig. Federal Support for Education " 
- Research and Related Activities, FY 1975-^77; i^relimiaary Report . 
' Washihgtonj^ & D System Support Division, Dissemination Resources 
Group, ^lational Institute of Education, Noveinber 3, 1976-; • ; 



79. 



''■if 




,77. Mason, Ward S., Bruce Craigj^=!:i'an:d Camot E. Nelson. Federal Support ., 
•for Educational Knowledge Product ion, and Utilization by Function / 
for Fiscal Years 1975-77 , Washington: R&D System Support Division, 

• » Dissemination Resources Group, National Institute of Ed\ication,y 
December 1976- 



78. Mason, Ward'S., William M. Somers, .and Camot E. Nelson 

- Estimate of FY ol975 Federal Funding for Educational Knowi^edge 
Production and Utilization, by Agency, Using Four Da£aySases . 
Washington: ; R&D System Support Division, Disseminatio^ and Resources* 
Group, National Institute of Education, November 



/ 

Moynih^n, Daniel P. "The Professors and the Poor,", in On 
Understanding Poverty: Perspectives from the Social Sciences , 
Daniel P. Moynihan,*ed.. New York: Basic Books, 1968. » 




80". Murphy, Jeromfe Ti "Legislative Program Evaluation." Harvard , 

Graduate School of Education Associatio/^ Bulletin . Vol . 20 , No . 1 
Fali/Winter 1975/1976. 



/ 



81. National Academy of Sciences. 



82. 



The/ Behavioral Sciences and the 

r ■■ — — —X ■■ 



Federal Government . Washington:/ Naticjnal. Academy of Sciences, 1968,, 



Nat:j.6nal Academy, of Sf^ciences-^National Research' Council and the 
'Social Science Research Council (Ernest R* Milgard and Henry 
Rieken, Committee Chairmen)/! Th^ Behavioral and Social Sciences : 
Outlook and Needs. Englewood: Pre'ntice-Hall, 1969. 



ERIC 



V 



288 



83. National Institl^feer of Education^ Building Capacity fpr Renewal 
and'JElefprm . Washington: NIE, 1973.' - 

84. Nfitibpal Institute^of Education, ' Catalog of NIE^duCatton Prodacts . 
Washington: NIE, 1976. . - - ^ 

85. ijational Institute of Education, Concept Paper for the/ School 



scnopJ 
ice 



Practice ^nd Service Division , Washington: School Pract 
Servic^ Division, Disseminatioa- and. Resources Group, NIE, April 24, 
1975. . : VI ^ ^ ' 



86. National Institute of Educiation. FY *1976 Plrograiy Budget . ' 
Wasfcingtoni\» NIE,' February 1, 1975. - 

87. , National Instituteof Education. Fiscal Year 19^7: Program Plans . 
, Executive, Summary . Washington: NIE, January 1976. 

88. National Institute of Education. Annual Report to Congress; 
' ^ Draf^. Washington, NIE, 1977. ' / ' 

89. ' National Institute of Educati'on. Request for Proposals to Es- 

tablish an "R&D Dissemination and Feedforward System: A Consortium 

; • ^ : & ^— — ■■ — 

of R&D Producers Disseminating- and Gathering Consumer-Oriented 
Information About R&D Products and Outcomes . " Wa'shington : NIE , 
> 1976. ' f 

90. National Institute of Education. Request for Proposals for Evalua- 
tion of the State Capacity Building Program in Dissemination . 
Washington: NIE, 1976. 

91. National Institute of Education: Request for Proposals for 
Studies in Utilization of R&D In Education ..- Washington: " . NIE, 
1975. • 




92. ' National Institute of 'Educatricto. JRequest for Proposals for a . 
4 ' Surviey of^. Institutions l^ich^B^^^^ Educational R&D — Research , 

Development, Dissemijiation, Evaluation and Policy Studies , ^ 
WasHingtont NIE, 1976 r—^^ — "^vf • ' r ' 

;• M ' ■'■ . _ . • ;'\. ■ • ■ . ■ 

93. National Institute 6f Education. The, Status' of Education Research 
and Development in the United States; 1976 Databook . Washington: 
NiE, i976. 

J- • .' .\ . . 

j ■ • . . . * * ■. ■-■ _ • 

Sf4. National Institute of Education. .Dissemination and Resources. 

t ' . • • ■ 

1 * ■ » < ' 

Group.' Dissemination and Hesources Group Program Plan, FY 1978 . 
. iv Washington: NIE, August 1976. , i * ' 

.95. ^Jatioiial Institute of Education. Dissemination and Resources 

^ (Jrpup. R&D ^System Support. Division. ^Program for' Monitoring - 

- ihe' Education KPU System: Current. and ^Planned Activities . > ^ 

Washington: NIE, December 7, 1976. . 1^ ' ' ' - . ' 

96. Nelson, Camot E. "Abstract and Information' Retrieval Services 
. ■-. ' . ■ , • - ■ • 

/in Educational Research: Curjrent: Status and Planned Improvement 

A Educational -Researcher . Vol. 3, No. 10, Novembier 1974. r - 

'97. Nelson, Car^not E. "The Communication Systfems Surrounding Arclfiyal 
Journals iA Education Research." Educational* Researcher,. Vol. 1, 
No. 9, 1972. • ; 

■'•♦*'» 

98. Nelson, Cafnot E. "Communication Within the Educational Research 
and Development Community — Suggeste'd Steps Toward Further 
Structure and Order." Educational Researcher . Vol. 2, No. 4," 

April 1973. • ' 

^ ■■ 

99. Nelson, Carnot E. , "Jburnal Publication of Material Presented at * 

an Annual AERA Meeting." Educational Researcher . Vol; 1, No. 8, 1972. 



0 

EKLC 



100. Niplson, Carnot El aha Carol- V..W; Adams. "Continuity ,of Research 
J Effort and SoUrces ofl Scientific^njE6rmation by Educational ^ \ 
Msearjchers.'^ Edjjca/ional Resgap^r ! Vol. 2;'» No, 6, . June 1973. < 



101. Nejbon^^^pot E., W. D, Garvey, ^d N. Lip. "Scientific Infonoa- ^ 
tion>^^:ahge Surrounding the ^968\nnual Meeting of the American 
Educational Research Association." Amferdbean Educational^esearch 

, Journal . Vol., 7, Nov 2, March 1970/ 

102. Nelson, Camot E.^ William M. Sougrs, an* Ward S. Mason. An Estimate 
of FY 1975 Federal Funding for EduS^tjonal Knowledge Proauction and 

' Utilization^ by Agency. Using Four Pata Bases . Washington; R&D 
System Support Division, Disisenjij^ and Resources Group, National 

Institute of^'Education^ November 1976. 

103. Office of Education. Educational Research and Development in 

the United States . Washl^ton: Government Printing Office, 1969. 

104. Office of , Education. Request for Proposals: EgEA Title I E\^luation 
. Workshops . Washington: OE, 1975. 

105. Office of Education. Special Study of Educational Research 
(prep'ared in response to request from Charles Schultz, Director • 
of the* Bureau of the Budget) , August 1967. 

106. Office of Education. Work Statement far State ESE/^ Title I Reports : 
. , 'Review and Analysi^k^^^ast Reports, tod Development of a Model 

Repo^tin^ System atj^Fbrmat:* . 'Washington:0E, 1974. 



107. Office of Education^ Office of Program Planning and Evaluation. 
• Review of the Programs of the Bureau of Research . Washington:-^ 
Office of Education, 1968., 



C ,i • - 291 - * 



^ ^8. Office of .Management and Budget. Social "Indicators, 1973^ Washington: 
Government Printing-office, 1974. / 

- ^^109. Organisatipn for Economic Cooper^ ion and Development. Reviews of 
. of National Science Policy; United States , Paris: OECD, 1968. 

110. Orlans, Harold.' -Contraoting for Knowledge . S^ Prancisco: ^ossey- 
Bass', 1973. 

^ ' ' • ^' 

111. Paisley, William J. "The Role qf Invisible Colleges," in The 
Educational Research^'CQmmunity; Its Communication and Sotial 

. Structure . 'Richard- A. Den^imer, ^ed. Washfhgton: American Education 
Research Association,, 1970. 



112. Paisely, William J. et_al.; Recommendations for the Disseminatioix 
and Utilization ™pgr at 
Wash4.ngton: NIE, 1972. 



C and Ut^li2ation^ 1^ of the N^tioiml Institute of Education ; 



' . . . V - ■ . . ^ ■ 

113. Per sell, Carolyn. Th^Quali'ty of Research on' Educatiog'; ^ An 
Empirical Study .of ^searshers and .^heir Work : New^Vork: Bureau 
of Applied Social Research, Columbia University, 197JL. 

m > , 

114. Ping^ys, John^ "Incentives for 'Innovation in the Public Schools." 
Review of Educational Research . Vol. 44„ 1974. , 



115. Radnor, Michdel, Earl C. Young, Harriet Spivak, and Ray Buckley. 
_^.a*^ - An Anarlysis' of Comparative Research/Development and Innovation 



, ^ Systems and ManageiAent; With Implications for Education . EvaiVBton 
Center for the Interdisciplinary Study of Science -^d Tecfttmiogy, 
Northwestern University ; 1976^" /\ ^ • M 1 v 



- 292 - 



116'. 



Randall, Robert The JPeve],opinent Process > Paper prepared: at-, the 

i >. -.i ^ < ■ ■ •■ „ ^"'^ ^ .. ^ - • •■ ; 

. Sduthwest Regional Laboratory, 1970. Reprintiad "in The Oregop Studies i 
" ■ * • ' ■ • • ■ ' j . ' ■ • * ■ " 

in Educational Research, Development, Diffusion, and Evaluation . 

Vol^ II; . >\Oie Literature of ' Educational RDD&E . ^ette C^' Porter, % 

ed. Monmouth, Oregon: Teaching Researbh, Oregon S,tate System of . ( 

Higher -Education, ,1972. . ' • ' 



117. 



118. 



119. 



Reuss',. Henry S.. .. The. Use, of Social Research In. Federal Domestic 
Programs . ^. WashingtonV, Government Printing Office, 1967. * 

■■ V ■•. • .. • ■ ■ *. ^ 

Sapone , Carme3l!6 iV . CURMl^l ^Curriculum Management Information 

System^and) Prospectus of a Design to Assist a High Scfiool Sta| 

in the Evaluation of Its Program . Paper presented at the Super- 

vijg|prs ConfeWnce, Annual Meeting, National Council for the Sbciafep^^^ 

Stud^,'l972. ' ■ ■ . '^•'•r^>W 

Sarason, Seymour B. The Culture of the Schbol and the ProbXem " 
of Change . Bpston: Allyri and Bacon,* 1971. ' 



XiO. Schulroan, Lee, "ed. Review of Jleisearch iri" Education; Volume 4 v^^^^^ 
V ' Itasca, '^Iirinois: F. E; Peacock, 1976. " - 



121. ^yiven, Michael. "The Methodology of Evaluation.'^ Perspectives 
of Curriculum Evaluation. AERA Monograph Series on Cutritulum " 



Evaluation. Chicago! Rand McNally , 1967. 



122. \ 



Sheldon, Eleanor B. and^.iE. ^oore, eds. Indicators of So cial 
[ Change; Concepts agd Measurements . New. York; - Riii^sellSage- 
iFoundation, 1968. - 



123. 




Short, Jfdmund C. "Knowledge Production^ and. Utilizatidfr^rln Curri- 
culum: A Special Case of the General Phenomenon-." Review of 
Educational Research. \^ol. 43, No. 3, Summer 1973. 



■1 



-293 



124; Sieber, Sara D. Analysis of U>S>0>E, Training Ptfog^aA s, New York: 
'Bureau of Applied Social Research, Columbia tfniversity, 1968. 



*125. Sieber, Sam D7 /'Organizational Intluendes on Innovative Roles," • - 
in Knowledge Production aifd Utilization jin Educgtt;ional Administration . 
T. Eidell and J. M. Kitchei, eds, 'Eugene, Oregon: ' .^Cfiriter for the 
Advanced Study of Educational Admimifitratjofr,^ 1968. 

126. Sieber, Sara D. "The Requiraraents of a National Educational R&D 

Systera." Addendura to R&D j^unding Policies of the National Institute 
^ of Education; Review and Recommendations (The Campbell Report). 
Washington: National Institute of Education, 1975. Reprinted ^n ''.. 
Educational Researcher ; Vol. 4, No. 11,. Deceraber>^975. 

Sieber, .Sam D. ,' Daren S.' Louis, and Loya Mitzger. The Use of 
Educational" Knowledge I Evaluation^ t)f the Pilot State Dissemination 
Prografa . 2 vols. New york: Bijre^au of Appliecf Social Research, 
1972. . : ' \ ^ > 



•128. Silverman, Judith S. "Research Planning in the NationaT'Center 

for 'Educational* Research and Development." Educational Researcher 
(newsletter). VJpl. 21, May 1970, * - , 

■ ■ -K' 

129. South Carqlina Department of Education. South "^Carolina Program 
for Information Dissemination; Final Report . 1973. 

130^. Special. Subcommittee on Education, U.S. House of Representatives. 



*gtudy of the United States Office of Education , 90th Congress ,Sf^st 
' session, House Document No*. 193. Washington: Government Printing 
O^ice, 1967. ' . / ' 

131. Staats, Elmer B. "The Challenge of Evaluating Federal Social 
Problems." Evaluation . ^ Vol. 1, No. 3, 1973. 



132, Stivers, Patricia E. "Researchers at NIE: From Planning into 
/ Actioij^," > gducational Researcher , Vol. 3, No. 5, May 1974. 

• ^ . .■ • • * . ' 'I •• \ • 

133. Storer, N. W. / "The Organization ^hd Differentiation of the / 

Scientific Community: Basic Disciplines, Applied Research and 
; Conjunctive Domains," in The Educational Research Community ; 

Its; Communication and Social Structure . Richard Dershimer, ed. 
Washington: American Educational Research -Association, 1970. 

134.. Stufflebeam^ Daniel L. , Walter ^ Foley, William J. Qephart, 

Egon G. Gub^a, Robert L. Hammond ,*'-Howard 0. Merriman, anrf.lMalcolm- 
M. Pfovus. Educational Evaluation and Dedision-Makipg . Itasca,' 
Illinois:. P., E. ]^eacock, 1971. ^ ^ 

135. Sttif flebeam, Daniel L. "Evaluation Enlightenment for Decision- 
Making." Address delivered at the Working Conference on Assessment 
Theory, A'ssociatipn for/ Supervision and Curriculum Development, 
1968. Reprinted in The Oregon Studies- in Educational Research . 

Development Diffusion^ ^nd Evaluation. Volume II; ^The Lit erature 

■ ~ . , " " V ' 

• of Educational RDD&E . Bett'e C. Porter, ed. Monmouth, Oregon: 

Teaching Research, Oregon State System of Highet Education; 1972. 

■ .. , 1 • - .... , . , ■ V 

136. Tallmadge, G. K. and D. ,P. .Horst. A Procedural Guide for Validating 
" Ttchievement Gains in Edudational Projects . Los Altos, California: 

• RMC Research Corpbration, 1974. 

137.. Task Group on Educational Research ^nd Development (Frank Westheijaer, 
Chairman), The Presid§;nt'9 Science Advisory Committee, Work reported 
in Office of Education. Educational Research and Development in the , 
United States . Washington: .Government Printing Office, 1969. 

138. Travers, Robe«^ M. W. , ed. The Second Handbook of Research on 
Teaching . ' Chicago: Rand- McNa^ly, 1973. ' 



139. Travers, Robert. "A Study of the Relationship of Psychological 
Research to Educational Practice, " in Training for Research and , 
Education . R. Glaser, ed. Pittsburgh:. University. of Pittsburgh 

- ^ JPress, 1962. - J 

■ * - * ' ' %• . , 

140. Tyler, Ralph W. "Analysis of Strengths and Weaknesses in Current 

^ ' • if" 

Research in Science Education." JourTial> of Research in Science 

Teaching^ Vol. 5, No. 2, Marth 1967. Reprinted in The Oregon 

Studies in Educational Research, Development, Diffusion, and 

Evaluation. Vol. II; T^ie Literature of Educational RDD&E . Bette 

Pprter, ed. Monmouth, Oregon: Teaching Research, Oregon State 

System of Higher Education, 1972. . • 

14:^. Utah State Board of Edixcation. Utah's Pilot State Dissemination 

Program; Final Report * 1973. 

•J ' ■ . ■ 

, ^ • ■ ■ / 

142. Wandt, Edwin et al . An Evaluation of Educational .Research Published 
In Journals . Washington: . AERA, 1967/ Mim'eo. 

143'. Wanger, Judith. Evaluation S'tu^ of NCEC Information Analysis 

Products:' Final Report . Fall^Thurch, Virginia: Systems Develop- 
ment Corporation, 1972. ' 

144. Ward, Annie W. , Bruce W. Hall, and Charles F.. Schramm. "Evaluation, 
of Published Educational Research: A' National Survey." American 
Educational Research Journal . Vol. 12, No. 2, Spring 1975. . 

145. Weiss, Carol H. "The Politicalization of Evaluation Research." 
Evaluating Action' Programs: Readings in Social Action and Education . 
Boston: All3m & Bacon, 1972. '^^ 

• "', ^ 

146. Weiss, Carol H. '^Where Politics and Evaluation Research Meet." 

Evaluation , Vol. 1, No/ 3, 1973. 

— ,j - 



CHAPTER FOUR 



THE R/D&I COWTEXT IN THE CIVILIAN AVIATION SEGTok 




^20 



\ 
\ 



ERIC 



THE R/D&I COWTEXT IN THE CIVILIAN AVIATION SECTOR 



ENVIftONMENIS OF THE R/D&I SYSTEM . • > 302 

1. Political Coadit ions • 302 
A, Federal Funding • . * • • • • • 302 

International Relations. ^302 

2. Social Conditions 303 

3. Economic factors. 1 .... • ; 304 

A. Federal Expenditures • • • • • • • 304 

B. The Technological - Economic Interaction. * • 304 

1. Airlines. . • 30^h 

2. Aircraft Producers. 305 

3. Other Economic> Factors. . 1 . . . . . . '30&, 

4. Scientific and Technological Conditions .... . 307 

A. A Well Developed Scientific and Technological 
Field. . 307 

B. Innovations: Abrupt or Cumulative? .... 308 

C. The Technological Imperative vs. User Needs. 309 t 

D. Signs of Increasing Civilian Aviiation 

^ Autonomy i. 310 

E. Summary. . . 311. 

HISTORICAL DEVELOPMENT ..... .V ... .312 

■ . ■ ■ ;7 ' . . ' 

1. Development of the Sector and the R/D&I System: 
Institutionalization % . 312 

A. The History of Industrial- Development. . . . 312 

B. Development of the' Aeronautics R/D&I System. 313. 

C. Changes in Experimental and Test Facility , 
Requirements . • 314 

2. Critical Events .......... . .... 315 

-A. Creation of Federal Agencies 315 

B. Key Historical Events. . . 315 

C. Current Developments in the State of the Art 316 

D. - Attitudes of the Public. . 317 

INSTITUTIONAL BASE (NETWORK OF INSTITUTIONS) 317 

1. The Structure of the Aviation R/D&I System. . . . 3l/ 

2. The Intra -System Structures 318 

3. R/D&I Institution Characteristics 320 

goals; POLICIES , STRATEGIES. . . \ 321 

1. Interaction Between Civilian and Military 
Aeronautics 322 

2. Participants in the Civil Aviation R/D&I System . 322 

3. R&D Within Civilian Aviation . 323 • 

4. ' General ....... j .... . 324 



ADMINISTliATIVE PROCESSES 325 



^21 



• ■ • ■ - ♦ 

■ . ■ ■ " • • ■4'"' . . ■ . 
' • VI. PERSONNEL' BASE . • • -> • • • • -■« .v . . . . 326 

• ■ • ' '*••■■.. 

VII.- - FUNDING. . . . . \ . . . ... 327 ^ ' 

" , ' . * * . • — 

. _ * VIII." ^fiiFOKMATION FLOW • • > •;• • • • • • • . • . T.. . . 328 

'IX. ' INNOVATIONS. . .- . . . . ...... 328 

.X.- , UfeSD IDEOTlFlc^jlON.. 330 . 

Xi. GENERATION/RESEARCH. .... 331 

XII. - DEVEl^^'^^^v . 333 

XIII. PRodUC5C^^^ • • • 33^ 

1^ A Custom Shop Process • • . • • 334 \ 

2. Control Systems 1 .L . . 334 V 

3^ Structure of the Aircraft Manufacturing System. • 335 

4^ .Quality Control * 335 

XIV. MAlUCETI^/^ISTRlBinJION/DISSEMINATION/DIFFUSION • . • . 336 

1. Market Growth . . 336 

2. Individual Firms: Feast to Famine 336 

* 3. . PTjDduct Positioning . .... 336 

4. 'predicting/Stimulating Future Demand. . . . . 337 

5. ' Obsolescent Equipment: The After -Market . . . 337 

6. ' .iiarketpiace'Characteristics ....•..*.... 338 
^ • . 7. The Producer' 3* Task 338 

XV. Acquisition. ... ^ ........ -.. 339 

XVI. iMPLEJffiNTATlON AND UTILIZATION 340 

1, Implementation. . • • . 340 

A» Close producer /user Coordination 340 

- . 3* ^nipiejnentation Requirements 341 

C. Software Aspects 341 

; - 2. Utilization 341 

A. System Impact 341 

/ ; ; B. ^ S^riers 342 

C* Servicing and Maintenance . 342 

XVII. ' SUPPORT SERVICES 343 

. ^ XVIII. EVALUATION RESEARCH. 343 

XIX. RESEARCH ON R/d&i'. 344 

■ ' - ' r 

Figure 1 — partial Model of Main Institutions in the Aviation 
r/D&I SysteniX , ' 

\ ■ m' 

ERIC 



CHAPTER FOUR 



THE R/D&I CONTEKT IN THE CIVILIAN AVIATION SECTOR 



Since 1959 the term "aerospace industry" has been used t|o denote the industrial 
sector serving both space and aircraft 'development and production. Space work 
has JjQen almost entirely devoted to serving the federal diviliah atid military 
exploration programs, vhile aircraft manufacturing, sfBrvesl both military and 
commercial users. For our purposes, discussion of the spice and military air- ^ 
craft cases would involve issues of lesser interest (given the specific naturfe 
and requirements of the users) than the case, of the civilian aircraft industry^ 
al|^ough, as will be seen, it is not possible to completely separate these sub- 
sectors; Therefore, the primary focus of our .contextual analysis will ie set 
within the civilian aviation industry. . ^ ^ 



l; Political Coadltloak 

»^ ' ■ ■ .,1. 

A. " Federal gundiiifis 

Federal funds going into Industrial R&D in the aerospace industry 

• ' ■ , ■ 

have tended to ejRcead company funds In the ratio of about 5 to 1 

(13) ^ ' * * ' 

(DOT ^ Ad ve noted above, each the significant stages of 

development In aircraft technology between 192^ to 1971 were preceded 
by periods of government funded R&D. On top pf this, it is ffederal 
money that supports the work of NASA, the source of most of the 
basic research in thfe field. Not surprisingly therefore it has been 
in thcs qp^gress and in the Exetutive brancli' (including at NASA Itself) 
^ that mu^ of the decisioiNifcking on the ratq and direction of equip-* 
meht B&D 'has l>een made. Additionally t;he roles of FAA and DOT have 
befen significant in the determination of airline policies and 
procedures, and, in turn, on policies and procedures of the manu- 
facturers .of airline system products. * Whether we are rjsf erring to 
prices, schedules, safety, flight pattema, maintenance requirements 
etc., lE^must be remembered tlxat the airlines industry is highly 
regulated. . ^ \ H ' 

t. ■ f ( ■ 

B. International Relations . 

I, Another important po^||:ical aspect is the role that aviation plays 
in '.intipmatlonal relations. Having a major airline has long been 
a matter of national prestige. Even small countries that can ill ' 
afford the inw^stment support their own flag carriers (even at sub- 
stantial loss in revenue i for reasons of prestige or for security 
' (as might be claimed, for example, b^ Israel^). 

■ ^ , ••-V- • • ' ■■■ . ^ ■ ■ ■ . • ■ ^ ■ ■ , • ■ • 

- *Although El Al does not in fact represent such a drain on that econonQr 
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Equally (or more) important has been the fact that ;naost of "the free 
worlds flies' in American made equipment, this time with economic as 
well as political implications • --The Anglo-French Concorde project 
is at Teast as much a political as an econoiaic venture. Iti fact 
it is probable that flights of these^ planes will need to be (and ^ 
will be) highly subsidized by theiir respective governments to help 
establish them in the marketpla^^ The present political battfe 
over landing rights for the Concorde has been said to have major 
implications for U.S. relations with Britaih and France. Also, 
considerable concern exists over. the possibilities of the U.S.S.R. 
becoming a source of. aviation equipment. 



Social Conditions 



This has all been taking pl.ace during „a period in which social acceptance V 

of airline travel has become established. During a period of approximately 

25 years revenue passexjiger miles hag increased an aye rage> rate of aboutr^ 

. . • ' * ' * (11) ^ 

13% per annum, rising to 20% or! more In some years • Over, the piarlod of 

' the last twenty years both total worljj and U.S. airlines have experienced an 

approximately twentyfold growth, and estimates for the 1976-85 period are 

for 50 billion dollars (worldwide) of commercial aircraft deliveries (at ' 

(13) 

constant 197^ dollars), almost as much as in th^ previous 25 years 

The "enormous and growing demand for the service and the product (coupled 
with the tremendous rate of change of the technology) indicated a user ^ 
- population that was "pulling" new R/D&I out^puts in a most intensive . 

; manner — although Schiff el '^^^ , believes that traffic growth acts 

as a '•permissive" fdctor rather^ than as a cause" g£ aircraft technological 
^ innovation and acquisition by airlines. The fact is that the use of the 

' airplane as a means of passenger and cargo transporta^tiibn Jjs established; 
and there is a pattern of expectations fox continual improvement in 
service (allowing for the effects of fuel crises^ etc.) , even though 
demand may. now have stabilized. 
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3. Economic Factors ' . ^ 
A> Federal Expenditures • 

Changing patterns of federal expenditures on spaci and defense have had 
enormous Impact on the aerospace industry. The indiistry^Kas a 
reputation of feast and famine conditions, with major layoffs and 
rehiring of even the most (Qualified personnel being comm9n. The 
federal bail-out of the Lockheed ^Corporation is a well known event. 

As we stated above, federal funding fof^^|j|^onautics R&D has been t 
substantial. During the nine years of 1967-75, approxlma:tely seven- 
teen billion dollars was spent by the federal government, with nearly 
two billion of this In .NASA. Further, the trend has been up » , 
approximately 50% over the overall period, and almost tripled at 
NA:SA (reflecting a shift back from space to aeronautics R&D). Such 
a^^^vel of support can hardly be ignor'ed. 

B. The Technological - Economic Interaction 

;It is also a fact that it is difficult to understand the technological 
and R/D&I system issues in the aviation industry without an apprecia- 
tion of the effect which economic forces and structures have on the 
producers of aircraft and their airline Industry users. Let us 
examine this interplay of these techno-economic relationships. 

1. Airlines ^ " 

Airlines are oligopolies^ hi^ly regulated in the U.S. by the. 
Civil Aeronautics Board (GAB). Fare competition is virtually 
non-existent both for major national airlines and in the Inter- 
national contest (under lATA control). 
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Two^-thlrda of the inveatment of airlines is devoted to purchase 
o*f aircraft.* Givep industry-wide price controls, competition. is 
transferred to service, image and operating cost differentials 
To a considerable degree, as Schiffel ^^^^ and Gellman^^^^ 
recognized, the .acquisition of new aircraft by airlines becomes 
a competitive device ^d as, we would note, a. defensive 
strategy (you can't afford to be using obsolete el|uipment at the < 
same ticket price for less service). This strategy has been made 
possible by tjxe continuing pattern of increasing demand^ (traffic) , 
at least up to recent times. 

2. Aircraft Producers • ; ^ 



r 



Aircraft producers (essentially the aitfirame matiufacturers) are, 
by now, also members of a highly concentrated oligopoly, with only 
three major manufacturer^ (Boeing, McDonnell Douglas and Lockheed) 
left in the JjJs. in^stry (whi^^in practice represents most of 
the non- communist world's civilian aircraft capacity).^ Other firms 
such asi Convair and Martin have been for^d out of the competition, 
with ever-growing tooling costs demanding long production runs and. 
hence concentration permitting economies of scale. 

Demand for new aircraft, while growing at a substantial rate,y/is 
not easily or quickly expanded beyond this pattern. The limited 
number of major airlines seek to minimize the variety of aircraft 
they use for a specific application (e.g.: long vs. short haul) 
in order to keep down operating and maintenance costs. Aircraft 
have relatively short first- line life cycles becaucse of rapid 
^5ytS9^^^«fesng^^ opportunity (frequently deriving 

from technology transfer from ^he military spher^. . 



* Recent trends towards leasing aircraft from equipment trust funds may 
be helping airlines to alleviate this major financing problem. 

# Although equipment may be kept on. for less competitive applications for 
15-25 years, and even longer in the afterm/arket. 



The prevlpi^iy mentlonad shift to service differentials (as ^opposed 
to price) as tliQ auena for alrllnej^coin>etltlon creates an enormous 
Incentive fot producers to be on the market with new products 
first . or not far behind.^ Because dlffusl^rates for adoption 
across the airline Industry is rapid, airlines lyst commit them- 
selves early to a new range pf equipment ~ and the latecoml'ng 
produ^ei^s sciueased out. The consequence has been fierce techno- 
^^Aoglcml competltton between manufacturers. Further, unlike certain 
other fields. It is virtually In^osslble to play the role of ^a 
technological follower who siibstli^tes marketing "clout" for tech- 
nological Innovation. The p^formance characterlstlfbs (speed, 
range, capacity, noise, operatlhg cost per mile, etc.) a^e too 
tlear and quantifiable across toost criteria to permit manipulation 
of a sophisticated customer, ti^e airlines. 

' ■ ■ \ 

3. Other Economic Factors 

Recent public concerns with envlrpnmfntal effects (noise pollution, 
etc.) may act to herald In a new W^ve product Innovation that the 
airlines will not be able to resist, despite the negative economic 
Implications that thiSy^would have on them. 

The changing economics of fuel may force the introduction of more 
economical equipment. Thus, for exasple, the airlines and airframe 
manufacturers have in the past shown little Interest iri^t^e NASA 
super-critical wltig technology that could promise a few percentage 
points of improv^inent in flight performance (and hence reduce fuel 
utilization) . The arena for cost reduction as the airlines saw it 
lay in the total cost of operatiojis mora than in f light' costs. *^ 
While this still may be/true, the sharp jump in aviation fuel 
prices has led to an upsurge of Interest £n ^is new technology. 

Another itq>ortant consideration has been the substantial role of 
aviation exports (civilian And military) as a factoYln the U.S. 
balance of payments, and the increasing threat of foreign compe- 



/"^tltilon* In 1971 aerospace exports surpassed 4 billion dollars. 
•Brlzendlne^^^^ estimated that 937. by value of the free world's 
civil transport came^ from the U«S. The ten year forecast for the 
total marketHa over 50 billion dollars. In such an environment 
R&D must and^does receive a high priority. 

4. Scientific and Technological Conditions 

A. A Well Developed Scientific and Technological Field 

While the histc^y that we have presented spans only seventy yeard, 
the scientific roots of some of the central disciplines can be 
traced back to the contributions of Leonardo, da Vinci, Gallileo, 
and Newton, with later work by Leonhard Euler and Daniel Bernoulli 
in aerodynamics. « * 

Modern aerodynamics dates from the tura of the last century with 
Idle work of Lanchester in^Agland; ICutta, Von Karman and Prandtl 
in Germany; and Zhukovski in ^Russia. In the years since, the field/ 
with its associated f ields op structures and materials, has become 
a highly developed, scientixic and engineering based specialty, with 
substantial experimental facilities such as wind tunnels being 
constructed. Aero engines date from 1851 (by the Frenchman G iff ard, 
^plied to airships) and from thk work of the Wrights and Manly 
in 196(p, with continued ^nd accelerating deyelopioents ' thrdugh the 
second' world war. The^ work of Whittle and others starting in* 1939^ 
in England and Germany ushered in the Jet age in the mid-194o's. 

In the internal combustion and Jet etii^lne^ technologies, we are 
by now dealing with a Vj^ry well understood and documented field, 
amenable to classical processed of scientific and "engineering 



*It is to be noted, however, that return on sales in the aerospace industry 
has tended to be around 2. 5<to'3.05i compared with about 4.5-5.5% for all 
manufacturing firms, although return on stockhol4^rs equity is about the 
same (DOT,^^^^ p.x^y. 1^ 
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'liiq>rovimient« The advances In aeronautical electronics are more 
recent but fall Into the same pattern^ with especially rapid ad« 
vancev in recent yeatrs with the progress of the field at large/ 
All together the 8ubfle\ds can generally be seen as highly special* 
4Lzed, scientifically and engineering based, and highly codified. 
Standards are a \fay of life for every detail and feature # 

* J* • 

An exception to the above pattern Is the more recent concern with 
human factors and use characteristics. In these areas (d.g.: as 
these might relate to cockpit and controls designs to provide high 
effectiveness y low fatigue, etc.) and In. the areas of passenger 
facilities designs, etc., .less developed areas of knowledge are 
being used. Similar problems arise in considerations of ^||||^^aan*- 
machine system aspects of flight, command and control, safety, 
etc. 

g. Innovations; Abrupt or Cumulative? 

We would be remiss in our discussion if we lead the reader to 
conclude that there is a continuing flow of radical and large scale 
Innovations stemming from fundamental (i.e.* ''breakthrough") changes 
in the state of the art leading rather abruptly and automatically 
into major new applications. There have been (and continue to be) 
considerable and continual advances in components and materials, 
some traceable to fundamental advances; and these surface, fr om 
time to tijne, in new aircraft configurations and models having 
radically upgraded characteristics. But it could also be claimed 
that there have been no' really radical innovations in aircraft from 
the time of the first jet planes up to the recezjp^tMSA developed 
super-critical wing technology. It can be claimed that what we 
have seen has been a series of cumulative (though v^ry significant) 
improvements. This is a perspective that is open to much debate, 
but it is congruent with the view expressed by Abemathy and Wayne 
in their discussion of the "learning cnrve." Regardless • 



of which viewpoint is "correct /j^e should note that the net result 
of innovftive activity in DQD, NA^A and industry has been a very 
significant trend of performance improvement over the last few 
decad^. « ' , 

C> T:he Ted^aiologtcal Imperative VQ. User Needs 

The^lmportaMe of technology transfer from military to civilian 
aviation ha^falready been noted. Such effects can be seen along 
the 'ij^ole hi^ory of civilian aviation, through the various wars, 
intO';):he Jet^ age and even recently with the wide body jet6 such as 
the B^ing,7<|f|)* (coming from the Air Force C5A built by Lockheed). 
The ddvel^miehts generated in this way have tended to push techno- 
logjMft the ^firedt ions of greater speed, , range and capacity. JChus, 
over ttie lastA-foj^ty years civilian aircraft have increased their 
cruise ^pee^Eifb]fi a facfior of three; their range by- a factbr of ten; 
and th^ir cd|^ac&ies (pay load) by factors of twenty to forty. In 
general, iKough not always, there have also been comparable improve- 
mentstin ec^^iy; and measured on a jpostj^j^er seat 'mile, there has 
been a o4Le-t|d!;rd reduction over the /j^sUe period. 

Ho\fi^er, as^e pointed out and as we wil£ demonstrate later, the 
objectives of R/D&I programs in^the military and civilian sphere^ 
arfe ^Ij^like, given the varying. pattern^ of needs. With much of 
the new aviation technology having flowed jErom the. military, ^±t] 
was only^to*be expected that rate and direction of such innovation 
did not necessarily match the^^anging pattern of needs* of the air- 
lines or the ultimate consumers (passeng^rs^N^d shippers of freight). 
As a consequence, new technological oppOrtanit:£es were bejng opened 

up in ways and at a. rate that were not necessarily to the! advantage 

# ■ • '> » 

of. the airlines to implement and exploit, but which they found 

themselves being forced to adopt because of the defensive non-price 

competition we noted earlier. These conditions lead us to look to 

the producer as the source and stimulator of the technological 

innovation process vis a vis the airline users. # . 
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There are, howeyer, other ^usea that point In the same direction 
and vhl^h might be expected to continue even fli the absence o£ 
the external military source^ of technology. An airplane is a 
hig;hly complex multi-component system, with many of these com- 
ponents operating close to their technological limits and' using 
state of the art knowledge. As^advanc^s^ emerge in materials , 
ii^strycturesy configurations , electronics , and engine design, new 
technical possibilities i^pear. These developments may have 
'derive4 from many sources. Inside and outside of the aerospace 
R/D&I isystems. The research. axid design fields are so specialized 
that one time we may see advances in fuselage desigi^i; at another 
In flaps or wings; at another in controls and so on. A neW air- 
craft system may, as we ^oted^ emerge through an accumulation of 
many improvements in many components — sometijnes adding up to 
a 8ubi9tantial upgradistg>^^in performance. Again, such improvements 
may or may^not coincide mth user demands — ' but the techi^ologlcal 
Imperative and stri^gjsncy of the technological demands n,onetbeless 
require aircraft and component manufacturers to be pursuing ever- 
^continuous program^^of research and development. . 



D. S^gns of Increasing Civilian Aviation Autonomy 



\ 




The drive of externally (military) fueled innovation may hav^ 
culmlnated...«iBrWe 1970 SST program. We. will discuss the goals 
of avlati'on R/D&I programs later, but for now we may recognize 
that an SST meets virtually none^f the objectives that seem to 
reflect the needs of airlines for new generations of equipment. 
It represents only an improvement in speed (made possible by the 
generations of si^ersoxilc military aircraft now in service). It 
rogresslve on capacity, fuel consumptle^ii^^^range, cost of 
Itl^ and environmental aspects.* This does not imply that 
SST s will not find a place in tl^^ market, katjier, the debate may 
indicate a maturation /watdrshedv^for th^^ W^earlier 
indicated 1970 as the achievement of. full raatilrftyT'lt may be 
that it marks the point at which the civilian aviation Industry 
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* 

began ta pull away from the toilitary source of technological 
innovation ~ perhaps even Ifi^ding to a ihore complete separation 
of the mllitatiy and civilian sectors. The implications could be 

(29) 

to make the patterns of intiovatipn so well discussed by Schiffel 
lets relevant for the future trends. 

Related technological developments may be going on in the less 
glamorous are^s o^^viation innovation.- In response to the growing 
potentials in developinjg countries (in the freight business, etc.); 
there is a growing interest in supplying low cost, short take-off 
and landing equipment. A combination of closer fitting of products 
to ttser needs, a substantial after-market^ (used planes), a growing 
concern by airlines in influencing the emergent features of the 
equipment they puifchase, and the previously mentioned increasingly 
close coupling of MSA aircraft research with the civilian aviation 
industry, may all.be signs of the growing autonomy of^the civilian 
aircraft industry. . ^ . ' 

E . Sinnmary 

The nature of "the aviAion industry makes it vital that we recognize 
the extent to vhich the industry lives on its technological in- 
novation base and the degree to which its policies and s*jategies 
are technologically determined. 
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III HISTORICAL DEVELOPMENT 



1. Deve lopment of the Stctor and the R/P&I System; Institutionalization 

The R/D&I ptoeess in civilian aviation could be described as highly institution- 
aliredl More thad seventy years ha|e gone by since the first successful flight 
in 1903. Since then « highly developed, and specialized industrial sector has 
grown up with a well defined division of activities both as to research and 
development and production roles. Substantial ^d specialized companies (e.g.: 
Boeing^ McDonneJLl Douglas) ^are to be found in the areas of airframe (aircraft) 
manufacturing as well as in engines (e.g.: General Electrlc> and in other 
equipment (Including segments of the electronics Industry). In addition, the* 
National Aeronautics and Space Administration (NASA) ~ which was established 
:^in 1958 to replace the National Advisory Committee for Aeronautics (NACA), 
founded in 1915 — • has well defined responsibilities in the more basic R&D 
areas. The Department of Transportation (DOT) and the Federal Aviation Agency 
(FAA) have clearly deliriiated roles in the implementation evaluation and control 
of.^^riation systems. 

A. ThlB History of Industrial Development 

■ ' ^- 

In a history of the U.S.. .Aircraft Industry, Simonson ^^^^ des- 
cribed the period of 1903 - 1930 as that^of the early industrial 
development. Stekler (^3) described the 1903 to 1914 period 
as being that of initial development. Up through the end of 
1913 only about 100 airplanes had been\built. Stekler refers to 
191A to 1939 as the World War I and interwar period. During this 
period production rose to a rate of 14,000 planes per year in 1918; 




Several ^^M^ especially helpful in supplementing the expedience of the 

authors with tH^ sector. They are: AIAA 6^/^^^ DOTv— 

;Schlf fel Simonson ^^^^ afid Stekler /^^^ The comments of Drs. Alden 

S. Bean of NSF and Frank A. Spencer of Northwestern University who reviewed this 

section were extremely helpful. 

la'; ..• I ' ■ • *. . 
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dfopping off aftqr the war and In the depression era; and then 
growing steadily until 1939, during which year not quite 6,000 planes 
were built almost 4,000 of which were for civilian use, World 

•War II tfaw productipn rise to close to 100,000 per year, then settling 
down to around 10,000 per year (including the Korean War period). 



The first 8pecial;tzed air transport manufacturing began; in 1926 with 
the Ford Tri-rootor^^"*^ and by the mid 1950^1 the airllrte industry as 
the major civilian customer was well established. Since then until 
^ today, the industry can be viewed as having achieved thf^ status of a 
^ mature sector 'with a steady pattern of growth and development. The 
superimposed cycles' of (military) activity and the growth and partial 
decline of the NASA space program since the late 1950 's have tended 
to produce something of a more volatile characteristic than for 
other mature industrial sectors. 

We might characterize the perio/ up through 1913 as the pre-birth 
phase; 1914-1939 as the introdifctory phase; 1940 through the early 
1950's as. the transition phase and the late 1950rs up through 1970* 
as the climb to maturlt^ with the last few years as the beginning 
Of the matured phase of the industry, using the Rubenstein, Radnor 
laker and ^fcColly schema^ ^^^^ ' 



B> Development of the Aeronautics R/D&I System 

t^aralleling this development of the industry has been jthat of the 
aeronautics R/D&I system. The lag in estabtfshipg an R&D .base foi^ 



*rhe date df the rejection in Congress of the^^T program and the beginning 
of growing airline concern with costs and 4^1e capacity. 
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thm ««ron«utic« ««ctor was relatively short - as can be seen by the 
early establishment of the NACA (1915), the forerunner of the present 
day NASA organization.* 

Throughout Its relatively short history the teclinologles of airframe 
design and materials, engine design, and materials and electronics 
have been subject to very great rates of change. These were described 
in a recent worksl^^p on the Role of Technology In Commercial Aircraft 
Policy Formation as a "vety perishable property'', with even relatively 
advanced modelb of aircraft being phased out In se/en or eight yeara (p. 
30). A Department ^f Transportation report ^^^^ (p. 8) described nine 
stages of aircraft development from 1926 (with the Ford Trl-Motor). 
through 1971 (with the DC-lO/L-1011), with each being preceded by a 
period of R&D ^largely funded by the U.S. government). Stekler ^^^^ 
(p. 96) took note of the Increasing role of R&D as compared to production*^ 
las the Industry developed. This degree of dependence on R&D and the 
close coupling with the maturation of the Industry permits us to recog- 
^^«e thft the R/D&I system has come through the same stsges of develop* 
ment ;bs the ^ectpy, with little lag even at the start, and reaching a 
point In our time when it could be viewed as totally established in the 
Industry. 

Changes in Experimental and Test Facility Requirements 

An additional factor leading to the .degree of institutionalization of 
^he aviation- R/D&I system has come from the changing character of 
the ex^jftrimental and test facilities required, . In our e^a, such 
work can only go on when there is access to very large scale facili- 
ties (wi4id tunnels, flight test facilities, large computers, etc.) 
The consequence has been to centralize sttch work in NASA, the Depart- 
ment of Defense (DOD) and the large aeronautid* firms - esa^tially t ^ 

*The British had set up a similar effort six yejars earlier (1901) at ' 
the National Physical Laboratory. The Germans pursued such research 
at this time at Go'ttingen and the Russians at Koutchino. 



eliminating much of. the diffused university baseji efforts in anything 
but the most' fundameipital areas (mathematical, materials and physics). 
This teirrors the similar institutionalizing effect's High Energy , 
Physics due to the need for larger experimental facilities (acceler- 
ators) as found by Radao#, Zaltman et al. f^^^ * 



2. Critical Events j - • * y 

■ ♦ - • . ' ■ 

A. Creation of Federal Agencies 

■ . ; * . .. • c • .. 

. ■ r ■ ' , 

The creation of NACA in 1915 was a .landmark in the development' of 

the U.S. aeronautics R/D&I system. A great deal of the .central R&D^ 

can be traced back to work at the Langley, Lewis aud other research 

centers . that wj^re created by NACA and which became the sources or 

seed 1>^ds upon which the later NASA was to be built. Federal support 

for aeronautics (including civilian), has always been a major factor; 

and by the 1958 National Aeronautics and Space Act and the Federal 

• * ■ . , ■ * ■ '■ 

' '-'Aviation Act (FAA)* of the same year , "Congress made proyision^f or 

nontnilitary aeronautical activities,"^ thereby supplementing the 
DOp aeronautics efforts in the military sphiare. The National Aero- 
nautics and Space Council was set up to coordinate related aero- 
nautical activities. 

Key Historical Events ^ . ' 

^ — — ■. . 

'. - ■ i 

Without question the oijaj^tlsf World Wars I and II (and to a lesser 
degree the Korean War) generated major impetuses in the development 
of aeronautics technology, R/P&I systems and the industry at .large^^ 
Significant technical .developments were pushed *to accelerated fru;S:tion 
notably, in electroh^cs, radar , and jet propuls;ion in the World War 
II case. The cold war acted to continue the pace of technological 
development in the military sphere. While there kre important 



♦Incorporated in the Department of Transportation Act of 19B6,. 



differences in the needs of mllit^y versus civilian, aircraft' re- 
quirements (to be discussed la^ei:), ithere has at all times bended 
t'd be a significant degree of technology transfer Another - important 
* Influence derives f rom 1:he consequences of the accelerated space 

program of the 1960*81 (the Apollo-man- on the moon program in par- 
':tlcular; but not exclusively), A '1970 event of some significance^ 
was the Congressional deeislLon not to support the development of 
Supersonic Transport (SST) in competition with the Anglo-French 
Concorde and Russian TupOlev 144 SS1>*^ The recent concerns with 
the energy shorfiage, cost, and the ^environment (air pollution and 
especially for noise) coming on the heel^ of the phasedown of 

-the enonnous space effort • have lead to something of a revival 
of civilian-focused aexioinautlcs R6cD as a laajor priority for NASA 
programs.. " ■ ^ * - 

C. Cutgent Developments in the State of the Art . . 

Besides the SST efforts*, some 'of the . current 'developments in the 
state of the arts concern the design of more economical and better 
perfolfmlng aircraft (using NASA-developed super critical wing and 

w. area rule-based configuration technologies);, the design of overall 
systems of .improved cQSt and "isafety features; and short and vertical, 
take-off and Imidlng aircraft. Particularly Important has been 
the role of the airlines^ with their own substantial R6J) capabilities' 
in the total design and implementation of systems into which the 

V aircraft fit as^one component (although to date, the airlines lack ^ 
similar R&D. capabilities in the- equipment design sphere). 



^Basic research is. continuing at NASA. ' 
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D> . Attitudes of the Public 

' ■» " • ■ • . , • 

An^ interesting comment ou the general public's attitudes towards 

: the product^ of the aeronautics R/D&I .system and of the industry 
- is the degree to which they are accepted with little or no question. 
New types of aircraft have been continually introduced into airline 
service with virtually Immediate ad'optioa by the ultimate users", 
ind;lcating a faith in the quality of the R&D, testing and evaluation, 
and control processes. * ' ' ■ . \ 



TLX. ' INSTITUTIONAL BASE (NETOORK OF INSTITUTIONS) • 

* 1. The Structure of the Aviation R/P&I System 

• ! • 

Very evident in the R/D&I system is the extensive specialization, be- 
tween institutions. .Fundamental -scientific research goes on in the; 
universities ^ some degree. and in NASA, which carries tesearch tdi^ard 
the proof of concept stag^e. Equipment manufacturers carry ^he R/D&I 
process forward through equlpm^nt^ development , design, testing, and 
production stages, the airline users do no equipment R&D, restricting 
'themselves to strictly defined implementation' and utilization of equip- 
ment in the larger overall airline syst^. Even the 'equipment itself 
(J:he airplane) > is specialized into major components — airframe, 
engines^ electronics (with even^ suijdivisiojis within.- these systems) and 
many or most of these are subcontracted- to producers who q;arry on their 
own R6S) prpgramsv The federal government supports the more_basic re- 
search, private industry the applied work.* 



*It is interesting to note that one of the arguments used in Congress 
to stop NASALS SST work was that in proposing to go on to a protptype 
sta^e they were encroaching otrHhe private sector role. 




Specialization goes even deeper, down to the scientists and engineers 
Involved in the R&D process.. For example, there are whole departments 
^ose personnel may s^nd their lives -on wing stress analysis* 

Additional specializatiori is to be seen in the^oles of FAA, DOT, and 
CAB, each re^onsible for researching and implementing specific phases 
of the overall air-transportation system. In turn, these governmental 
institutions have clearly defined control and regulation roles. 

2. The Intra-System Structures V '^^ 

■\ " f ' . ■ ■■ • . .. ■ ' _ 

While the specialization is^ as we noted, very great in the aviation 
R/D&l system, for the most '^p art the work goes on in a very limited 
variety of injstitutional settings. ., Md^ in the R/D&I 

system can.be found at NASA Kand DOD) ; .at the airframe manufacturers 
and thei^ associated (in pari^llel) subcontractors*; and in* the u tiliza- 
tion R6eD area with the airlines, with supplementary activity in DOT 
(FAA). Universities play a relatively minor role in the prodess. ' 
Figure 1 is a partial model, representing these institutions and their 
relationships. 

Thus there are three prime participants in the aviation R/D&I system: 
the basic technology sources (NASA and DOD in parallel) > the equipment 
producers y and the users. ' Each of these contribute specialized ele- 
ments to the R/D&I process. Except for the indicated parallelism 



^ *It should be nqted that while there are. other types of civilian users 
(e.g«: the private and corporate aircraft market) these tend not to be 
a major factor in the R/D&I system. 
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... Partial Model of t^e Main Institutions in the Aviation R/D&I System 
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(as between airframe manufacturers and subcoi;|itt'actors) the -systein Is 

highly linear; there Xs a well established workflow;' relatrlonshlps 

"'^ ' i. ■ ■ ■ ■ ' I - x ' 

tend to be most Intensive betweeio^ Inistltutlo^s iflth adjacent R/D6cI 

functions; and so on. There are no obvious ^aps between functions , 
al'^hough questions could be raised '^as to wbeljher all of the most 4 
desirable linkages exist. For example, in sbme of'our own research 
we nated some potential shortcomings Ixitjhe^ degree to which the airlines 
were connected into NASA's techttal6glc^l .development' in tesms of their 



forward planning, and vice versa. /^3Qhe only, arfeas of, r^ might be 

between some of the work going-^o^ li^ IfASA/POD ^^nd NSAS/M and a fedieral 
committee w;is established to bring about n^cessar;^' coordlttatibn. 



3. R/D&I Institution ^ Characteristics . ' . ; / ^ 

The; R/D&I system is dominated by; very large institutions, whether 
we are referring to NASA, the major .equlpmeilt manufacturers, or those 
airlines that play a meaningful role in the R/D&I process. .While 
they are all highly formalized, their characteristics reflect their* 
roles in the system. ^ ^ :^ ' , - ? , 

* ■ . ' ' ' * ■ ■ ■ . ' 

NASA is made up of a series of TeseiSrch; centers, ^ each/ tending to 
specialize in? some aspect of spacer'and aviation technol^y. Aviation 
tends to represent only a smaller part b£' the Overall NASA mission 
and is of concern, to only a few .'of the centers. ' Sbme of these centers 
are involved in the more ]>asic aspects of aeronaut;ics or power plants, 
Qlchers in more^ applied flJLght systems' progr^msl A center may have 
several thousand persot^el, a ^arge 'proportion of whom are scientists 
and engineers supported by technicians and other persjbnnel. In their 
appearance and work ^styles 'these centers are university campus-like, 
but they are organized ajid managed in relatively formal ways. In the 
technical areas,, personnel and /departments are -^highly specialized. 

Airframe manu'^acturers are sjbrudtured 'like- most high technology firms, 
but reflecting the special needs' of aviation. Again there is very high 
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specialization between departments which do R&D work, con^onent design, 
systems designs, specifications, materials engineering, stress analysis, 
testing, etc* on through production, inspection, marketing, and 

' so on* Airlines are structured around their roles of providing a service 
to the ultimate customers and are supported, by numerous a pplied research, 
analysis and system design groups* Manufacturers and airlines stay in 
close touch with each other at the commercial and technical levels* Air-- 
lines become involved in the usual market research and advertising functions 
to stay in touch with the users of their service — hopefully identifying 
needs and demand* « 

Finally, we might note that cooperation, licensing, and even joint ven- 
tures are quite common. In addition to the already mentioned subcontracting 
that goes on between the airframe manufacturers and the Producers of 
engines, electronics, etc*, it is not uncommon to see several firms join- 
ing together to win a given government contract* The extensive special-^ 
ization in the industry creates opportunities for manuf apturers which 
can be realized through cooperation* 

' . ' ' 

IV« GOALS > POLICIES / STRATEGIES 

... ; J 

A vital initial parameter is the recognition of the size of the aero- 
nautics *R/D6cI system* tf we include federal funds, we are talking 
about an industry that spends something like six to seven billion dollars 
^ a year on combined space and aviation R&D (although only about 107o will 
pe company funded) . To this must be added the funds spent within NAS^, 

pOD, etc. , themselves* Even though the proportion of these vast amounts 
that axe devoted to civilian aeronautics is . the^smaller part, it is still 
a very large amount, and it is embedded in and an integral part of the 
largest (by far) industrial R&D system* 
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r. Interaction Between Civilian and MlltOlgy Aeropautics 

^.^.^.^..^ 

military and civilian aeronautics. However , there* are substantial dif- 
ferences in the goals of the R/D&I programs. Ii/ military R&D the 
programs are oriented towards the dey^opment o4 complete weapons systems 
emphasizing various aspects of performnce (speed, maneuverability , 
hovering capabilities > as well as ran^e and carrying load) . For civilian 
application^ ^^^^ the objedtlves must |be pointed towards improvements in 
econon^ (usually fuel coQSi:i|ption) , mi^ifeenance costs (pay load) , noise 
and polluction as: well as faster crul« pp^ed and greater range and capa- 
city.* Nevertheless, there does tendlto^ be a great deal of commonality in 

i. ■ I ■ /l3^ i 

aeronautical requirements and technical disciplines^ (p. 22). The 

■ ■ ■ • • ■ < ■/ 

tendency has been for the civilian sector to benefit thereby reducing the 

if'-' 

technical ^Isk associated with the^ commercial application. In this sense, 
the odlltary has been the field test' p^rjaying grounc^^r a great deal of 
advanced aeronautical technology going into civil .aviation, although we 
have questioned this as a trends fo^^&tt^e future. 

2. Participants in the Civilian illation R/P&I System 

Turning to the specif ici partidpai^lls In the civilian aviation R/D&I system, 

the following ckn be observed ^^^^ (Jp.. ^7): 

"NASA addresses ttie development o^ a reseiarc^ and technology pro- 
gram to support and enhance ttie vi^rious disciplines which encompass 
c4.vil aeronautics.' NASA also-'undirtakes technology programs directed 
toward the solution of specific aircraft problem areas. Guidance 

is provided by the Federal Aviation Administration of the Depart- 
ment of Transportation^ (DOT/FAA) in terms of the perception of 
the need for techntology application to both categories of interest. 
The government also derives assistance in developing guidance 
from joint government industr]^ councils. 

. • ■ ^ . i' ■ ■'" 

DOT/FAA pursues ai^ay and air^traffic control technology, as well 
as airport and runway engineering and development, particularly 
as it applies to airp>prt layout, traffic flow, vehicle movements 
and pavement desigh.'' .' ^ 



*The differenced may be continuing to Increase as military aircraft 

' > *\ 

take on missile capabilities and chatacieristics. 



In addition, we could add the role of 'the universities which serve as. 
a source of fundamental knowledge to NASA and DOT and which also perr 
form certain contracted research from these agencies. Then there are 
the industrial firms (airframe , engine and other component manufacturers) 
. who do the applied development and engineering design work (airframe 
manufacturers do^ery little basic aeronautics research) through the 
prototype to prpduction model stages. The objectives of ^these latter 
participants have already b^en stated in general technological and 
economics terms. 

3. R&D Within Civilian Aviation 

I ;; ' . 

Airlines have ^^l)ae virtually n6 R&D on flight equipment. Their concerns 
have centered on c^e utilization of equipment as part of the total air 
transportation systeh^. Thus, airline directed R/D&I has been focused^^^ 
on aircraft maintenance, equipment scheduling, trafflq flows, passenger 
handling, freight and baggage handling, ticket reservations, food and 
beverage service and In- flight passenger entertainment; I.e.: with 
Implementation/utilization characteristics. Since the 1970 's however, 
airlines have become Increasingly concerned with aircraft and fuel costs. 
Idle capacity, safety, envlronxpental Issues, etc. This concern has 
had the effect of Increasing their pierceptlon of a role In the 
rate and direction of aircraft Innovation (essentially along the 
lines of more planne4» controlled and need oriented equipment programs). 
As a result. We have seen in the last few years something of a shift 
In R/D&I goals. As ^e noted, up through the early 1970*8 the emphasis 
was on the development of aircraft that could fly faster, higher and 
further, and with larger pay loads at comparable costs. It was these 

criteria that spawned the SST. Recent emphases have been towards- 
economy (especially in fuel) , utilization characteristics, environ- 
mental impact (with noise reduction being a major priority) and life 
cycle costs. ' 
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4. General 

Looking across the spectrum, of aviation R/D&I programs and objectives 
we can note that as we move from the universities through NASA to the ' 
producers and then users of aircraft, the time horizons tend to shorten, 
the objectives and applicatiohs become more specific. It is also im- 
portant to have a sense of the brflance between the research, develop-, 
ment, design, prototype building, flight test, production designs and 
tooling stages. Expensive as the research may be at the NASA and even 
company levels it is small compared with the cost of the later develop- 
ment and engineering through tooling phases. The investments in these 
later stages can be enormous. Nevertheless; as St ekier^^^^ pointed 
out, the balance between R&D and productrion investments has been char- 
acterized by .a continuous increase in role of . R&D • . Whether this has 
beguct^to plateau out remaii|^s to be seen. 




While the aircraft industry is managed in a generally similar manner 
to most large scale industrial firms, there are a number of character-^ 
is tics that are particular to this context. These characteristics 
relate to the need to tnanage a process that is so fundamentally R^D&I 
based; the structure of the industry (particularly the fact of the 
critical priioe/subcontractor relationships); the enormous complexity 
of the equipment systeiqs; the highly codified and specified information 
anfl data base; ' the ^extent of external regulation and control; and 
the previously discussed economic and financial structure of the industry. 

These ^^^^tBBH|fe^6 givep rise to a large ^number of management methods 
that have com^^tobe known as aerospace management methods. These ^ 
have to do with the management and control ft)f large scale R&D projects, 
systems engineering and Management, simulation techniques, forecasting 
methods, cost/benefit studies, reliability studies,, contracting tech- 
niques, logistics methods, etc. The success of these methods in their 
application to this industry has lead some to suggest that they might 
be more widely disseminated", without always recognizing* that their^ 
applicability may be limited by the specialized context of their source. 

■ • J ' ■. - " - 

To attempt a complete review of the aerospace administratiye process 
function would require an analysis far too exten'sive fory^his illustrative 
analysis. Instead, we will simply list here 25 speclgj^V^chniques and 
concepts derived from the aerospace industry as discussedy^b^ Milliken 
and Morrison, ^^^^ It is to be borne in mind that their paper was written* 
for the general business community (in the Hazard Business Review"^ with 



view to promoting the possible diffusion of these techniques and 



concepts • 






Systems Analysis 


; 2. 


Cost/Effectiveness 


3. 


Decision Analysis 




Heuristics 


5. 


Simulation Modeling 


6. 


Forecasting 


7. 


Delphi 


8. 


Systems Engineering 



V 



9 

9. Reliability Analysis 

10. Maintainability Analysis 

11. Value Engineering 

12. Project Management 

13. Mflitrlx Structure 

14. Government /Prlvatie Corporations 

15. " Procurement. Systdtas 

16. SEB Process 

^ 17.^ Incentive Contracting 
—18. Contractor Performance Evaluation 

19. Management Information Systems , * 

20. Reporting Display SyiB terns ^ 

21. Scheduling/status Recording 

22. PERT/CPM 

23 ^ Configuration Management 

24. Logistics Management ' * 

25. Quality Assurance V ^ ' . 

• . * . • } 

VI. PERSONNEL BASE ^ 

The aircraft industry uses very large numbers of scientists and en- 
gineers as well as other highly skilled raanageraenJ: and control personnel. 
In 1971 out of a total employment of over one million, 175,000 were 
scientists and engineers (it had been 56,000 higher in 1967) and 58,000 



lid 
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techniciatis. ^^^^ These tend to be highly specialized perionn^l, ^ 
and having the proper mix and quantity of persdnn61 in specific areas 
is critical. Use of skills InventoriiBs is one method of keeping on top 
of this issue, 

0 

The industry is notorious for ups and downs (mostly reflecting . 
the shifts- in military and space programs) resulting in massive hirings 
and layoffs of highly skilled personnel,\ This can be misleAiJing to the 
outside observer. Thus a great deal of ^Jkilled technical work in de- 
veloping an aircraft consists of highly programmed detailing (e.g., stress 
analysis). In many ways this is R&D production work. When large 
numbers of engineers are laid off the brunt of the cutting is in these 
direct R&D produ^ption areas. Protected are the core R/D&I personnel • 
without whom it would be iiopossible to develop future programs. Even 
for the core group there must be turnover. The high rate of . obsolescence 
of skills demands a continual infusion of new blood. 

^' ^' ' ^ 

Salary levels tend to be high and there appears to be some status 
associated with working in the industry. Naturally there is great 
mobility within' the industry, as various firms wax and wane with the ^ 
success^f their programs, 

VII > FUNDING 

- . ■ ^ ♦ 

• The importance of U.S. goveriteient funding has already been mentioned 

(^he government was largely responsible for supporting the R&D that 

preceded .most ot thi^ ^j or technological advances). Over the ten year 

period, of 1958-68, the federal government spent about $5 billion per 

year on industrial R&D in aerospace, while companies were spending 

between^ $1/2 to $1 billion per year of their own funds. Fitzsimmons 

of McDonrtff^Douglas estimated that in 1974 total U.S. aero-. 

nautics R&D was "down to a total of something like 10 percent of civil 

sales." This would generate something like $6 to $8 billion in civil 

aeronautics Rfi^ by 1985. Together this represents an enormous R&D base 

(even though most^of the direct expenses may haVe been non-civilian 



oriented.) 



^ Funds from the U.S. governmej||l^ that can benefit civilian applications 
are those going to NASA for specific research programs, and the inde- 
pendent R&D allowed on defense contracts. Company funds must be gen- 
erated by sales. This has tended to produce instability for firms. 

The ilfe cycle of a development program through production up to 
first sales 'can be very long. Firms must risk very large investments 
In R&D, tooling and first production before much revenue comes in to 
repay the Investment. The ela^^d time could easily exceed ten years. 

^ Average rafces-of return tend to be somewhat below the rest of industry. 
Combi^d witlLJ:he high* risks, the, sector has not proved attractive 
•enough to keep all the firms in or attract new entries, resulting in 
the oligopoly situation to be found today. Without governmental 
support bf^ne sott or anothe!c, the predominant role of U.S. manu- 
facturers and the flow of innovation would not have been possible. 

VIII. y INFOBMATION FLOW 

At the ,b as ic research level (but excluding work from the military . 
aphere) the flow of information wit^n the industry and between in- 
dustry and .government ^^nds to be rel^atively free. , There is wide ex- 
change of ideas, even on ah international level, with publication, lab^ 
oratory visits, etc., be^g common and hence essentially uncontrollable. 
In the more applied development and design phases, in the application to 
production,*" companies attempt to control inf oirmation. flow and to maintain 
secrecy. - , • 

IX. innqvaAqns • ' 

The Innovations in the aviation sector hav^Jvery large-scale requirements. 



6irect to airlines or to in^tutions who then lease to. airlines, 
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Costs are enormous » especially for develop;ai#nt , but there Is a large 
amount of federal funding of basic and Applied research, and (through DOD 
contracts) of development • As the Innovations- themselves are very close 

■V- -' 

to the^ state of the art^lKhere Is a blgh level of complexity and sophis- 
^ tticatlon of technologies Inyplved, Many highly skilled , specialized 

personnel are required* Long time spans are Involved, Thus, very complex 
' R/D&I systems are required. We find coordination and orchestration of the 
system being ^one by NASA at the research stage and by airframe manufact- 
urers at the development through Implementation stages - - and coopera- 
tive relations throughout the innovation process 'with support service 
organizations, ^ 

From the user side of the R/D&I process, the" innovationlf requirements in- 
volve performance/cost improvements arid the need for the innovations to 
"f it" ipt^ the user's operating system and capabilities • 

( ^ . . . ■ ■ • ■ ■ 

Additiemal requirements exist in terms cf the ttultitade of governmental 
regulatory and control activities in relation to performance, safety , etc. 

The real li^e cycle ot civiliPan* aviation, innovations is quite long - - 
indeed the older propeller planes have had very long real life cycles. 
Safetij^ arid air worthiness are the basic criteria for the limits of real 
'life,' requiring a continual process of maintenance and updating of equip- 
ment. While the real iif e is long, the competitive life in the^^ljii^^, 
primary market is much shorter - ~ with aircraft being sold to an "after 
market" (small airlines; cargo) before the real life cycle is completed. 

The' quality of the innovation is a critical element of the R/D&I process 
•r. - both in terms of the objectives of cost/performance improvement!; 
and in .terms of safety, and reliability factors (as already noted). Thus, 
the innovations must be (and actually are) highly testable, 

•For the most part, the innovaffions are limited to aviation per se , but 
there Is a fair degree of "spin off"* Aircraft themselves can be adapted 
to a variety of applications (passenger/cargo; long or shorf haul; mili- 
tary/commercial). 



From the pel^spective of transportation objectives, 'innovations in the ^ 
civilian aviation sector have been^xnE great benefit to, society. Ho\^ver, 
we have already noted that many p^eople dxe beginning to question thp 
larger costs pf noise and environmental pollution; and that^ innovation 
have at times been "forced** onto the airline companies* ^ 



X> NEED IDENTIFICATION 

■ . ■ ■'■ , ' . " 

The degree to which airline needs for flight equipment are determined / 
by a complex interaction of competitive and techno^bgic^il forces hag 
already leen discussed. From this, we saw that it is difficult to separate 
airframe manufacturer responsiveness to airline needs from their behsYior 
in generating these needs. Thus the locus of need identification c^n 
be vlrfSualized the intersection of ultimat^ consumer*^demand as trans- ^ 
mitted through ai^^e planning and the output of the aircraft production 
R/D&I system. ~ / , 

Airlines depend on market research^ demand analysis ^nd sophisticated 
planning functions to identify and translate ultimate consumer deiaand 
int^ equipment requirements, in the light of techno/economic/ political' 
conditions. These are converted into equipment operating, economic 
and environmental requirements. Equipment producers stay in close touch 
with the airlines own' need identification efforts but attempt to 
achiev?*^ leadership position by translating technological opportunity 
into features that meet current, potential or stimulatabl6 user needs. 
Since producers must ultimately compete for the airline equipment 
business (despite the oligopoly structure of the industry), something ^ 



of a balance between the airlines and the equipment producers is 
achie^d^ That this balance is not always- totally, achieved is demonstrated 
by the rehent airline experience in over-acquisition of wide body (jumbo) 
jets, vhy:h generated considerable over and idle capacity;, and by some 
of^*e-^parently less than ethical tactics of manufacturers in their 
marketing efforts, which have been coming t;o light in recent days. 
In general, however, the process that xan be observed over many years 
has been one of relatively smooth integration of emerging technology 
into new equipment that meets the changing patterns of consumer demand. 

XI. GENERATION/RESEARCH 

We can usefully introduce this section by quoting directly from^the 

AxajEtricari Institute of Aeronautics and Astronautics sta^ment 

on the Design of Aircraft (p. 30): 

"Design technology, as it relates to the field of commercial ^ 
aircraft, is largely conceptual in nature. It constitutes the 
basis for the selection of nc>t: only the final product itself, 
but also the individual compohents or supporting elements of 
• that product. In another sense, it includes the methodology 
used in realizing the basic design ^OTcept, as well as the 
logical integration of the many ind??idual elements — com- 
ponents, subsysteils, and procedures -3- into the complete, 
functionaliaircralt system. ^ . ^ 

It is possiblej of coui:se, to identify and to discuss the 
specific tec^jijjjyLogical elements of the design prpcess; e.g., 
computer-aided structural, aeroelastic, and aerodynamic design 
methods, supercritical aerodynamics, "winglet" vortex dissipators, 
graph it e-epoxy composite structural elements, numerically-controlled 
manufacturing , processes, etc.." ^ - y 

The above statement well illustrates the extent to which the develop- \ 
ment and design phases of the R/D&I process depend on detailed and 
scientifically based bodies of fundamental knowledge in physics, fluid 
dynamics, structures, materials, etc., as well as in combustion, heat 
transfer, electronics, and so on, for the non-airframe components. 
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.'This knowledge comes from basic rese^ch going on at the universities, 
but moi^substantlally «t NASA and DOp and to some degree in In- 
dustry, with this last sector taking on the major applied V 
research role. Both laboratory and field research are involved, 
materials testing laboratories, enormous wind tunnels, simulators 
and large scale computers combine with extensive flight, testing of 
new concepts to provide the experimental base for the aeronautics 
parts of the field, with similar situations existing for the R&D on 
engines and electlifcics, etc.. This phase of research generally 
stops short of prototype development. 

The nature of the R6J) is such that it. is often carried o\xt by teams * 
rather than individual researchers, with many project teams reaching 
very large size. While creativity is important (as always), progress 
jnore t^feplcally occurs through the accumculation of a myriad of detail 
advances In the state of the art. Really revolutionary new concepts 
have been relatively few. In the civilian sphere (as opposed to the 
military) publication pf results at therbasic research level is fast 
and open. Interstage technology transfer is achieved rapidly and 
efficiently. Even though , as we noted, much of the research goes on 
in , large mission .oriented institutions (NASA, DOD, big companies), a 
very professional environment is maintained within well planned and 
coatT-olled programs. NASA research centers, for example, provide 
research environments equal to or better than those at most universities 

f 

R£J) programs may be focused around specific applications (such as an 
SST or a vertical take off and landing {^VTOLJ aircraft , etc.) , or 
arbund problem areas (materials, noise, energy, pollutipn, speed, etc.). 
In fact, something of a matrix exists between problem and product- 
directed programis, with a fair degree' of interchahgability. Thus, 
Congressional action could stop NASA*s SsV program but might still 
leave intact most of the applied research that was required 
for the SST objective. Thus it is possible toc^ay for NASA to be fairly 
advanced in SST research without having had such a- program.* 



*The maintenance of national technical readiness even without a hardware 
program is seen as one of NASA's missions* , - 



ERIC 



Xll. DEVELOPMENT 



The really complex and high cost aspect of ^J||||r/D&I process is that 
which goes on within the industrial firm's in the transition from 
prototy^ to production ready and te^t^d designs. The design phase 
is critical for the success or failure of the firms in the industry. 
As we implied earliep and is Harlan<^^)^p, lO) has noted, design 
is the arena of airframe manufacturer eonipetition, leading potentially 
to major gains^ or -losses of market share (i.e.: a much more sensitive 
situation than that which might ^be found, for example, even in the , _ ^ 

style conscious automdm industry). : " V;^ 

•■•v.: '< \ . 

Development of the prototype is a critical stage. Where this 'fcccurs 

• ., . ' " '. , • -i: ■ ' " ' ' 

is not always clear-cut. NASA typically mod;Lfies and expetiihents^ ^ ' . 

with aircraft as* part of their r.ese^urch ef fori;.. %^t; what ^oiA a'new 

concept has emerged in protptygfi^fotift is not always pbviq]ia^^J.^lJough ^ ' V ; 

formally the building of producmiori protptypes iiX the^role >af the 



ufacturers — and fox specif it i^odels this is^cle^p'-cH^ 
Development throi 



>ugh en^^-neer i^g^^^^ ^si^n ^jj^'p^e^^^^ irighly sophi||^ ^ 

tljCated and speciallz^. Numerous /' ' . -'v 

design, systems integr^tio:A,^pjerf6ijg^^ ^ f 

The ultimate tests take place in"^ te^^ing^ 




Technology transfer^ is aVcrif ical /e,lement of the d:^vei&pment f un^^tion - > 
of the aviation R/D§tl; system.. .We/tt^Ve Already meni^o^^^^^ ^ \, 

to-civilian aspect. Fo^^^^xarapl-fe, ^the develbpjront^ a^^ ^. 
C5A transport by Dcl> froia a given, fltjn make/deveilo'pment of "a civilian - 
passenger aircraft iof 'tltts san[ie (wid^ bddyy type.mvich more feasible^*- ' 
Similarly, d^evelopifternt o^^ new genfer^ticJa^ equipmdrit Vy 'One ^^ijin^an^ ' . - 
will be quickly followed^\)y ''its vcopi^'eVi^^^ / 
attempts to transfer; tB^chnol^ijjr across 



*Recent legislation forbidding proto'type bu^^ldiftiL on DOD/c'ontrac:^ s 
without a clear military nirfssion may be dimiti^^ Auch ^.ttter-program 



technology transfer. . V ' ? 



when CQmpanleis Ip oiie cpuntry assemble aircraft (using some local 
dbmponentii ,atid mliterials) designed elsewhere (such as Fokker of 
Holland apsemblitig Lockheed airplanes). Always difficult, this may 

' 'be/^05ttpounded by the very complexity of the aircraft system, with its, 
highly qrltlcal interdependence of materials, design and function, and 

' possibly i:eflecting cultural as well as economic and resource dif- 

fefiences^ Thus, for example, materials engineering became 'a major and . 
near determining function in the effort of Israel Aircraft Industries 
to"^^ produte initi^ly French-<iesigned and then self-designed equipment. 

XIII. PRODUCTION ^ 

V . ■ ^ ■ ■ 

1. A Custom Shop Process 

., ' ' » 
The production process for. aircraft is more reflective of £[ custom shop 
working on, batch orders than that which laymen visualize as the typical 
• high production industrial scene. While there are production shops ^ 
^that use presses, cutting and turning equipment, etc., to produce 
» components, the main manufacturing areas are large hangar-like spaces 
In which a batch of aircraft are painstakingly built up, giving manu- 
/facturers a fair degree of flexibility in introducing new designs into'* 
*the production process. The' cost of tooling remains a major component 
of the total investment, since to an important degree each new aircraft 
sjrst^em r^uires the design and fabrication of new manufac^turing, assembly 
fiid test tooling — much of it of a very costly nature. Nevertheless, 
ps Was noted by DOT^^^^ (p. 58) 757a of costs are in personnel (develop- 
ment as well as production) — I.e.: it is a labor intensive industry. 
.■ \ • ■ 

.-.».*.. 

2, Control Systems 



The production control system is geared around the ctJ^bp shop environ- 
ment. Relatively little production is for stock, and mS^t major airline 
customers require variations In features. Thus, production plans have 
to be geared to specific orders and customer determined delivery schedules 
Since lead times for obtaining and manufacturing components an^ for 



the actual assetably are long, careful and detailed planning is re- 
quired. 

3. Structure of the Aircraft Manufacturing System L— / 

It is important to clarify the structure of the aircraft manufac- 
turing system. As Harlan ^^^^ noted, airframe manufacturers "do 
not manufacture, ijji the strict sense of the word, all the basic com- 
ponents of the planes they produ,ce." Rather, the airframe manufacturers 
act as the "primed' producers of the equipment and they^ .purchase engines, 

electronics, etc., from other industries who act as "subcontractors." 
(33) 

Stekler speaks of "prime contractors, associate prime contractors, 

subcontractors which manufacture systems, and subsystem manufacturers." 
In any case, the selection and control (cost, schedule aad quality) of 

subcontractors becomes a maior production issue for the prime airframe 

- ^ (12,16) 
manufacturers ^ ^. 

\ 

4. Quality Control 

Quality control and inspection (both in-process and final) are of 
central importance in the production process. Unlike most other 
products, aircraft manufacturers cannot afford to correcit their mis- 
takes in the field. D^pite (or perhaps as indicated by) complaints to ^• 
the contrary (compared' to almost all other sectors), this itidustry can 
be seen as payii?g great attention to product quality and safety. Anything 
else would be disastrous in both social and economic terms. There is 
no place for seconds. This issue becomes compounded as a source of 
problems, diven the great rate of obsolescence of aircraft and the 
consequent inability to upgrade quality and design over time as part 
of the usual learning curve. Another compounding problem is the degree 
to which materials and structures are extended to the feasible extremes 
of their capabilities in consort with the need to keep weight down to 
a minimum. ^ 



o 
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XIV> MARKETING/DISTRIBUTI0N/DI5SEMINATI0N/DIFFUSI0N 

•\ / , 

- i ^ • 

This feature Includes several aspecjtsTof the "bridgl,|ig" function between 
knowledge producers and ' knowledge users. In the civilian aviation sector, 
the primary Issue Is marketing, and we will thus limit our, discussion to 
marketing. 



1» Market Growth 



An Important parameter for marketing ip fhe fact that the airline 
market (as measured, for|example, in r^enue .passenger miles) has 
had a substantial and l^teady growth, Vome (e;g,: Stelner ^^^^ ) have 
projected that this will continue to grow at 6~87» per year over the 
next decade, so approaching. 1,000 billion revenue passenger miles by 
1985 (excluding the Communist world markets) — which translates 
inCo a $60-80 billion aircraft sales market. 



2, Individual Firms: Feast to Famine 

While the gross volumes sound, and are, impressive, they must be 
evalua:e4 1n the light of their fluctuating 'character, particularism 
fot any givaaa^irm. Given the changing character of equipment with 
: the f adt thi 

no logical advJBa«s, firms may well swing from feast to famine. Aotually, 
the miliary (rither than the civilian) markets have been the worst or 
most fickle^fc«Stomer as far as creating conditions of volume fluctuation 
for the manufacturers. 

3. Product Positioning ' 

The positioning of products as to capabilities, features and pricfe 
is critical. Different aircraft' can serve different markets more or 
less efficiently (or at all). Thus the type of equipment needed for 
trans-oceanic flight differs from tfibse re'q^^ 

travel. Also, it has been state^ that Ijjjjji^re is a growing ^ 
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need for thirty to fifty passenger aircraft designed for operation In 
short haul city center to city center markets (In response t6 a demand 
for such service m the U.S. and even more abroad) > thus Indicating a 
market segment that may be growing at a faster rate than others. New 
equipment must be designed to fit such changing market segmentation. 

4. Predicting/Stimulating Future Demand V 

r 

This Indicates the importance of knowing and being able to predict 
and/or stimulate future equipment demands from airlines at home and 
abroad. It then* becomes the' task of top level sales personnel to 
obtain orders for sllfflcl^t volume to permit the manufacturers to 
make the necessary Investments Into tooling and manufacturing a new 
product, thereby establishing a market (usual^Ly with one or more major 
air llnM) that others will follow. As noted above, production, will, 
by and large, then be tied to the specific additional orders that can 
be generated. The previously discussed need for airlines to compete 
In non-prlce^areas (through product and service differentiation), 
together with the matching of aircraft performance to service needs, 
becomes the focus of equipment sales efforts. Nrhus, close customer 
contact on a personal basis Is obviously a rjsquirement for successful 
sales efforts. Thp airlines attempt to capitalize on having innqvations 
in equipment, usually >'y assigning therji fArgt to the most competitive 
routes (wher^ possible), arvd by maximizing their publicity to promote 
tt^ir use of hew equipment (e.g.: as Pan American did , with the Boeing 
707 and 747 Vs and American Airlines with the DClO's). < 
^ 

5. Obsolescent Equipment; The After-Market 

' ^ O . , 

It is of interest to consider what happens to the equipment that becomes ' 

obsolete in this process of rapid innovaM?l.on and proactive marketing. 

There is a substantial ai^ter (used) market for aircraft in secondary 

airlines and cargo transportation. The ability of major airlines to sell J 

obsolete equipment has helped them to finance the^nvestment in new 

, . ' $ ^ : 

aircraft, thus helping fuel the irinovat Ion process. However, growing 
demands for such products may be offset by reductions in equipment life 



(of th« big Jeti) and Increasad cost and complexity of maintenance. The 
^ future of the aircraft after-market and Its Impact on the R/D^ process 
haa still to be determined. 

6, Marketplace Characteristics \ . 

The economic and political characteristics of the marketplace are 
Important. As noted , there are only a very few major airframe manu-' 
facturers. The number of airlines Is greater » but In many of these cases 
(e.g.: for the national , airlines of other countries) , political and 
national economic considerations compete with airline economic factors 
In determining what. Is bought, when, and from whom. Additionally, 
an airplane must meet any local legal and regulatory requirements (e.g.: 
see the debate on permitting the Concorde landing rights In the U.S.) 
that may be slanted to serve national Interests. Also, manufacturers 
may be supported to greater or lesser degrees by their governments for 
larger economic, Security or prestige reasons (e.g.: Lockheed In the 
U.S. and Rolls Royce engines In the U.K., to name but two highly 
publicized ekamples.) ' \ ■ 

Finally, it is important to recognize that the major airlines (the 
smaller ^itees tend to follow their lead) are relatively aophlstlcated 
customers. They are well informed on the operating and te<ihnologlcal 
characteristics of the products they buy, and highly skilled in their 
implementation an^ utillaation. That is not to say, that they do not 
raak6 mistakes (as fpr example with the DC7's and Boeing 720' s which 
turned out to be Inferior to their predecessors, and the failure of 
the turbo -compound engines). 

7.' The Producer's Task 

~ - ''^ 

The producer's task is to create a set of conditions (technologically, 
competitively, price, delivery, and terms -wise) that make the purchase 
of his product the most rational decision for the airline to make (subject 
to the political, legal and economic considerations: e.g.: currency 
availability, constraints that may be operating at th^'.time).' . 
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XV. ACQUISITIOH 



'^Airplanes are very expensive products, and, as we noted, represent the 
major part of an airline 'al investment •» Airplanes are also a major 

* it ' 

determinant of, their competitive capacity. That is to say, airlines 
cannot af|prd to £ly inferior aircraft. Thus, deciding what to buy 
and when can be the most critical decision an airline can make. Air- 
lines- therefore make it their business to stay aware of new developments 
from their very earliest stages, eyejci ordering before the first pro- 
duction airplane has been complebecl, in the hope of gaining a com- 
petitive position. They are equally prone to cancel orders if problems 
(performance, delivery, political or economic) appear — creating a 
very unreliable market. A major continuing constraint is the ability 
to finance the rapid and Expensive new product introductions that may 
make obsolete their present fleets. 

Schiffel ^^^^ lists the following factors which he says should be taken 
into account in making the acquisition decision: 

1) Overall demand for air transportation 

and the demand in relevant specific markets; 

2) "" Extent_8ixd ^^haracter of price flexibility ^ 

and competition; 

3) Price (or rate or fare) level and 
structurie; 

4) Exte;jit and character of non-price » 
competiti(xn, including that embodied 

in flight equipment, enroute and ground 
service^, etc.; r 

5) Extent and nature of market competition; 

' 6) State of Aviation technology; / . 

7) Availability of investment capital; 
, 8) Availability of ''suitable*' aircraft; 
9^ Capital cost of flight equipment; 
? 10) Operating ^ost of flight ejquipment; 
11) Exposure to risk; and," 
l^HkAircraft manufacturers' sales policies* 



EquipiMnt may be purchaaad becajige it i« seen by aa airline to have an 
optimal fit with ita prkeent route structure. Hotraver these structures 
can and do change and the Impact on , the ••fit'* may be hard to predict, 
aometimea' leaving the airline with leas that optimal aircraft for their 
routes. ^ . 

Another Important concept is that of the ••launching purchaser^'; i.e., 
an airline that launches a new airplane by becoming its first acquirer 
and promoter (as did American Airlines with the Dp 10 and Pan American 
with the Boeing 747). This gives the airline the initial competitive 
edge while absorbing the risk of introducing an innovation, and may 
lead other airline adoptions, the objective of the manuf act^irer . 
Some foreign countries may give governmental support to their airlines 
to pursue such a policy Xe^/b.: in France). 

Acquisition Meci^ ions are critical for the airlines. As we pointed out 
they are sophisticated buyers, even though mistakes have been made. 
With the ever- increasing cost for equipment )and the growing financial 
constraints, the selection behavior has become even more analytical, 
displacing some of the •'old boy" network considerations that may have 
tended to exist In the past. This^ need for careful «ialytical planning 
has become reinforced as ditlin«#i paitticularly more recently, have 
come to recognize the system-wl4e implications of the aircraft acquisitii 
'decision. 

XVI. IMPLEMENTATION AND UTILIZATION 

1. Implementation 

A. Close Producer /User Coordination 



Implementation in the aviation industry often begins while thd 
design is still on the drawing board. There is close coordii/ation 
between producers and users to tailor the equipment to\ha/needs 



of thr airllM. JUvmn after th« modtl It In gcnoral production, - 
tha tpaelfU order will be tailored to year dealrea. How the 
^ airline will ute the aircraft and the criteria that will be used 

to evaluate performance are well defined In advance oi! « implementation. 

Bi Igplementation Requirements 

r - 

The requlreaenta to actually implement a new aircraft are many, 

■ ^ . ■ '-f 

With operating features such as speed, range and capacity likely to 
be changed by a new acquisition, revisions may be needed in operations, 
routes, schedules, etc. Maintenance requirements and facilities 
are likely to be different and will require, preparation. This can 
l^e a costly and long process, demanding considerable pre'^planning. 
Retraining requirements for crews and maintenance personnel can be 
very extensive. Th% general public may need to be prepared with 
maJ.or promotion programs. Trial runs will normally precede general 
introduction Into scheduled flights. Thus, a decision to introduce 
new equipment usually implies a major change on a system wide basis. 
While the airlines are highly skilled in carrying out such changes, 
new acquisitions do generate major disruptions for aixlines.> 

C. Software Aspects 

So far our discussion has focused -on the hardware aspects of Jthe 
aire raft. At^ this point it is also important to note that there are 
software dimensions to the product that play a vital role in its 
impleaentation^and utilfzation. The manuals, specifications books,.^^ 
parts lists, ^tc, that come with an airplane are unbelievably ex- 
tensive. Complete specifications of operation, maintenance, parts 
and so on are a vital component of an aircraft system. Without them, 
impleaentation would not be possible. 

2, Utilization 

A. System Impact 

* 

New equipment can be used to supplement existing aircraft in* a * 
growing market, or may be used to open up new routes where this 



er|c 



is permitted and desirable. When it supplants existing aircraft, 
these may be moved^to other routes or applications or sold in the 
after-market. When the change is a radical one (as was the first 
introduction -of jets in^the late 1950's) then a. whole restructuring 
of the system is* required to accomodate the new approach. Personnel 
and facilities need to be reoriented and changed. 

b1 Barriers 

•; :^The inc^nti'Ves to innovate have- already been discussed. The barriers 
are generally cost, customer acceptance and political, legal and 
regulatory constraints. There are also potential system level 
technological* constraints and barriers. Foir example, not all airports 
had runways that were long or strong enough to take^he first gener- 

\ at ions of jet transports. There , may be similar deficiencies in air 
traffic control capabilities. Thus it is not enough to have a 
.better airplane. The airplane must be; capable of being congruent 
to the systems of which it becomes a pai;t:, or conditions must be* 

. extant that permit other system features to be upgraded (build better 
runways, etc.). Finally, we are today also recognizing the extent 
to which aircraft^ Jiaye-. an important impact^^on our environment and 
that' this JLmpact must, be considered ais a utilisation criteridn. 

C. SgrvicTng and Maintenance . ' " 

Once in service, aircraft must be serviced and maintai<(e<l (including * 
parts and compbnents replacement} in a frequent, detarled and pte^- 
scribed manner. Also, fronj time to. time, changes will be incorporated 
requiring test-ing and approvals. Unlike most, other equipment, air- ' 
craft have to be kept at a .near -new condition at all times. Pre- \^ 
• jpentive maintenance arid replacement ' i^ fchd .norm. Failure's of even^^l' 
minor components relating to the operation^ of the airplane can 
cause grounding." Costly spares have to be inventoried in various 
locations. This^ll adds up to a^costly and critical aspect of 

equipment utilization. 



Since the aircraft industry is in fact an amalgam of several industries 
(airframe, engines, aircraft electronics, etc.) it is tiit really feasible 
to discuss support syAems as a separate feature. Many industries provide 
components to either the primes or subcontractors^ and the cost outbuilding 
an airplane would be prohibitive but for the existence of this structure 
of suppliersl Much the same could be said, or the equipment (production 
and testing) suppliers, and for the may-jSptg^ 

to airlines. Large airlines will have ^liei^Jiown service functions in* 

many areas. Si^all lines can contract these out. Various^ types of 

companies have emerged specializing in the provision of various kinds 

(23) • % 
of serv'ices. Thus, Stekler ^ . notes that there have eveia developed 

management companies providing systems management and^oordlnation 

service^ (e.g.: TRW, Aerospace Corp.) to DOD and NASA. • 

XVill. EVALUATION RESEARCH ^ ' ^ 

As we not ed^^^ir craft are subject to extensive cotaponent and system ^ ; 
testing and evaluation through development and during and after pro- 
duction, with this meticulous ^froCess continuing into service (for 
equipment used to provide servia& to the public) . No airplane can be 
introduced into commercial service which has not received FAA certifi- ' 
(^cat^ion. . Once in service cletai^led records have to be kept on flight 
i history, maintenance records, changes, etc. Unusual experiences on' 
"^crashes can lead to the grounding of all aira^ft of a given tjrpe. 



When an^ anomaly or crash does occur, detail^WBj^'estigations. are made 
to identify the causes and to -institute corrlMllve actions as seen ; . 
necessary. The alrlineis make their own; cost , reliability and- customer 
response, evaluations of new equipment. - 1^,^ 



As we noted, the ciyilian area*'-depended in the/past on t3ie .military 
for considerable tetchno logy traiisfier which included reliabiiity, safety; 
, and proof of concept data. The airlines would not generally buy an 
airplane that had not been fliight tested by the military. With the 
divergence itx heeds and the changes in the law regarding DOD contracts, 
this may become far less feasible and hence represent a major added 
cost factor. * 

XIX. RESEARCH ON R/D&P 



He are not aw^i^^. of any. previous attempt to analyze and describe the 
civilian aviation R/D&I systiem from a comprehensive contextual perspective. 
This Is not to say that there has not been research on various 

aspects of R/D&I in the cijvilian aviation sector. Obviously, much has 
been done, as the list of references at the end of this chapter will in- 
dicate^ Thus, we find many studies on such aspects of civilian aviation 

^ (10 24 29 

R/DM as the economics di'the aircraft and airlines Industries^ ' ' 

32, 33, 34) ' ^ i. ^ ru 4 ^ ..^ ^2, 7, 11, 13, 15, 20, 30, 31). 
, ^-F,^-r/. nature ^of the industry^' ' ' > 

' (23 25 26) (4) ^ 

the effects of technology on economy^ - ' and on the Industry ; 

(3 5 8 17 19 22) 
on the technology per se^ ' ' ' ' ' ^ ; on planning and opera-: 

(6, 12, 16, 18, 21) ■ ' 
tlons V • ■ • ^ I etc. > v 
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THE R/D&I CONTEXT IN THE HEALTH SECTOR 



Major contributions to this chapter were made by Thomas Pipal- 
and Robert D. Hamilton, III. ^ 
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Perhaps the two. words which most accurately characterize the health 
R/D&I system of this country are growth and diversity. Until World 
War II, funding for health research came almost exclusively from 
private foundations; t^ vast majority of these funds being spent 
for clinical research* Government involvement at all levels wsia 
episodic and ephemeral. . , ' ^ 

By 1947, the medical R&D programs established during World War II had 
come of age. The development and wide use of such wartime discoveries 
as penicillin, gamma globulin, sulfonamides, and cortisone had shown 
the vfelue of concentrated, directj§d approach towards medical research. 

- In the twenty- five years from 1947 to 1973 total expenditures for health 
RficD increased by a factor of 40 (from $87 million to $3.54 billion) In 
constant dollars; government expenditures by a facjfor of 82 (from $27 
milflon to $2.23 billion) (NIH 1974). Indeed, these doilar amounts 
are somewhat understated because they do not include those-funds spent 
for resjearch on the organization and delivery of health services. 

The diversity of the health R/D&I systems can be most easily seen In 
the multiplicity of problem ireas under consideration and %he number 
and kind of institutions involved in Jthe process. 



lie 



Applied research focuses specifljLoally on the clinical aspects of health 
care. Examples of this activity; include the development of a rubella 
vaccine, organ transplant techniques, and the continued exploration of 
a wide range of pharn!aceutical~^agents (e.g. chemo-therapy for cancel^ 
broad spectrum and sp'ecific antibiotics, drug* therapy for psychiatric 
disorders, etc.)* A]lso, developmen^ts in rehabilitation techniques 
ihcludinig the use of mechanized prostheses would fall into this 
category. 



- 354 - ■^■■ti. ■ ' . I 



Active research programs are to be found at most university medical- 
schools; teaching hospitals; numerous state, local and voluntary hos- " 
pitals; private research insti^^utes; governmental research facilities; 
and many places in private sector. Clinical areas under considera 
tion include^ aero space and nuclear medicine, pediatrics, epidemiology 
. pharmacology, virology, hematology, psychiatry, obstetrics, neurology, 
immunology, internal, medicine, surgery, pathology, radiology, and 
numerous others. Within these disciplines, special research efforts 
in specific disease categories receive special att^ention. Cancer, 
cardiovascular diseases, muscular dystrophy, multiple sclerosis, 
cerebral palsy, and cystic fibrosis consume large pojrtlofis of the ^ 
research dollar. Also, the basic life sciences, medical technology, 
and related studies in the physical sciences and engineering conmand 
considerable suppolj^t. Obviously, this list is by no means exhaustive 
of the topics treated within the health R/D6el system* It should 
serve, however, to indicate the vast diversity in the field. 

This anal^ysis attempts to describe and define the basic nature of the 
health R^D&I system as it has evolved in the United States, using the 
* nineteen contextual features of the contextual analysis frameworks- 
described in Chapters One and Two. This will allow comparison with 
the contextual analyses of the education, aviation and ^criminal justice 
sectors provided in other chapters of this vofume. 



Two points must be noted here. First, this analysis is descriptive, 
not prescriptive. ^ 

Second, because the area of "health" can include a broad range of 
considerations, • it is necessary here to fofcus on a particular aspect 
of health. Specifically, this analysis focuses principally on the 
health services aspects of health R/D&I. It does not include con- 
sideration of such areas as health education, preventive medicine, 
mental health, alcoholism or drug abuse. 
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I. ENVIRONMENT * 

\. P^ltlcal Conditions ' 

As will be noted later, the Federal government has become the primary 
funding source for the field. (Table I). At the present time over 60% 
of all medical R&D In this country Is Federally sponsored. In 'addition 
to this, many sectors pf the f leld ^e almost totally dependent upon 
Federal monies. 

Because the Federal government supports over 60% of health related 're- 
search In this country it has an enormous Impact on the levels and con- 
sistency "of research funding. Federal grants^^^^ contracts provide over 
40% of the revenues of the nation* s medlcaT^chools . Sixty-three percent 
of these funds are for research and development. The Federal government, 
however. Is as dependent upon the Institutions as they are upon the fed- 
eral government. Assuring reasonable stability serves the Int'erests of 
both^partles. The recently convened President's Biomedical' Research 
Panel (1976) spoke against the fluctuations and recommended that the 
Executive Branch and the Congress authorise forward funding of extramural 
grant and contract supported programs. 



If we-^elimlnat# the approximately 30% of R^SeD expenditures made by phar- 
maceutical and hospital equipment fltins, JB| dominance of the field by 
the Federal government (and thus the depenroncy of the R&D system) -becomes 
readily apparent. * i 

t 

2. Funding^ - Political Problems 

■■ " ' ' 

Funding of research is both a scientific and political process . The 
budgets proposed by each administration are based on ceilings origina- 
ting in its Office of Management of Budget. The Department of Health, 
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TABLE I 



PROPORTION OF TOTAL FEDERAL RESEARCH AND DEVELOPMENT 
FISCAL YEARS 1947-73 



Fiscal Year 



Total Federal R. & D. 
(Including national 
defense and space 
exploration)^ 



Total Federal 
medical 
R. & dA 



Millions of dollars 



R. & Pu as- 
a percent of 
total Federal 
R. & D. , 
(percent) 



691 
863 
1,105 
.1,175 
1,812 
2,194 
3., 361 
3,039 
2,745 
3,267 
4,389 
4,906 
7,123 
8,080 
9,607 
'11,069 
13,663 
15,324 
15,746 
16,179 
17,149 
16,525 
16,306 
15,834 
16,161 
17,109 
17,992 



27 
56 
84 
109 
105 
126 
121 
131 
143 
171 
267 
318 
407 
496 
628 
838 
1,002 
1,139 
1,287 
1,424 
1,530 
>,626 
1,706 
1,688 
1,900 
2,217 
5,334 



•%'j5 
7.6 
9.3 
5.8 
5.7 
3.6 
4.3 
5^.2 
5.2 
6.1 
6.5 
5.7 
6.1 
6.5 
7.6 
7.3 
7.4 
8.2 
8.8 
V^.9 
9.8 
10.5 
10.^ 
11 -.8 
13.0 
13.0 



'"Includes expenditures for research facilities. 



Source: Medical and health-related research dat^; NIH/^ Total Federal R&D 
(1947-71J^ - Federal Funds for Research and Developmeiit and Other ScienDific 
'Activities, National Science Foundation , Vol. XXI.-. 1972-73 Special Analyses, 
Budget of the U.S. Government, Fiscal Year 1974. 
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' Education and Welfare allocates pOTtions of the whole budget to, the 
NIH ^nd Alcohol, Dj'ug Abuse' and Mental Health Adiqinistratibn. The In- 
stitutes then have to ind'dify their .figures to fit their proposed bud- 
' gets into the. given overall figure. ' ■''.^ ■ 
* ♦ ■ * . ,*'*,* 
. The i^ongress, l^eyer^ has the power. d'f the purse. It appropriates 

the^unds fbr health research. It is subject to the .pol^ical pressures 
** of its constituents as well as the petsuasibns of 'the various interest 
groups around* the health R5J) trough.^ Both groups have, historically 
focused oi)i curing the well-known killer diseaflj^i^v rather than on the 
nreV€;At.at;ive aspects; or. the economic costs associated with disease.' 
The "imbalances th^t this focus has wrought: arevshoj&m below '(W.eai;y 1977) . 



Not' only aVe there seriouQ. imbalances between the various institutes 
Vut within a particular institute there may be gross ^distortions of 
the rescjfci^ch funds expended for a particular disease in relation to 
its economiJ^osts. The National Institute l)f Arthritis, Metabolism 
■"^^ ; is a aooX example. This is a case wherfe the 

\- -p^ strength qf^'c^rtain lobbies and the appeal, of a particular 

- disease can dl,fer a rationar, scientific allocation process. • 



In general, funding medical R&D is a relajt^yejiy "fafe" prdposilildn for 
^legislators. National health insurance remains a controversial issue, 
* , but * few question the worth of continued research. The question there- 
fore^ Is .riot st) niych whether or not to s"PPQ ^ research^, but. ratfher what 

- resliarch to; supppft, and &t what Xeyel. tC j^; c 

* • ',.'*'', ^ . " ' ' ^ . . . * * ■ 

J ' ' • ,.■..-■■■* 

. . - 3. So&ial Factors ..^ , 

: There ate thret soci:al f actorsr of. some significance to the health R/D&I ' 

y''^^\' - s'ystem.K-, First, despite^^ the dang^fc||( inherent' in drawijig coQclusioa^ from 
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; . COMPARISON APPROXIMATE i^OONTJS OF ilONEY , 

BY CATEGORY ' OP • MSEASE PEH^ DOLLAR OF ECONOMY LOS**< TO 'SOCIETY* 



CANPER 



"■it 




[ra-teAL-STRGKE-COMMniTECATIVE-EtE-' ' 
blABETES-ENDOCRINE-METABOLISM-NUTipTlbl . \ v 
MENTAli^EAtTH y • .:. . 

HkRT-LUNG-BtOOl) - 
KI9NEY -UROLOGY > 
toRITIS-BDNE ^ 
SKIN DISEAS^//' - v 
i)rG69i%,ii5EASE 
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ANALYSIS OPiCONOMIC LOSSES TO THE AMERICAN PUBLIC m ; 
OF CATEGORICAL DISEASES FOR WHICH RE?EARCjl , 
IS PREDOlNAmY'SUPPjlRTEpBY 



I THE NATIONAL INSTITIJTE OF ARtHRITIS , mm ' 




(3). DENIAL DISEASEJEXCLUDED FOR COMPARABTLITY ™ nU5 l Irn, • ' * 



FOR COMPARABILITY ^TH COOPER & RICE ARTICLE 
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trendd It is ireful to examine the grcv 
I960 about 5% of the Grors National ProdxjJ 



n hfealth. In 
bullion) weivt ^for-healdi; 



by 19^0, $70 billion (7% ^of GNP) Was- cf pent . By l?Sp ilj^fl' e^^^^ 
heai^-y^ 9% of the GNP for a' total of $20D'^blillon. (Hepner 



atid ^Hepner 1973^. While there is cmg|roversy *as to^the ;liDp^ct of a nation-*' 
aV'?h'e$lth insurance program that could lead to furthet Increases in demand, 
at: 'the very 'least it indicates an increasing social place for health 
care* in-our present and futu'^te lives. 

[egative side, th^ increased ac^'tivity of consumer j^roups hasi lead 
ntdi regulatory agencies' such as the Fedeiyl Drug Administration 



Oh 

goirlfefcfl 



of a 

^ Longer and more rigidly contralled 

^^^p^B^^d^^ validation of results, places a signific|int 



y^ to^l^^^ on the development iand production 

*T -i^^'^te^^^ Longjer'^and toore rigidly cor 



le^^iflyate: Sj^ctor of the system. Non-profit organizations in 

^^^'AlsQ subjected to more stringent review of research proposals, 
- ^ ■ ' ; * ' . *^ • ■ ■ ' ^ 

L'arl^ with .Regards to the ethics of the methodology and the applica- 




Ctor* impacting 'ttie system is the willingness .o&^prac* 
ubrfit^ ne\^ products into their present, activities. Moral 
^b@^ q;f\.^lpractice suits filed annually has 
he last seven years. It is now 
X^^ctoTQ presently practicing wiir 
,S*end7o#hVs^he career. (Time 1^74). 



an iflxctea8e4 specialization 
9b<<jnay- b^^better informed 



fyu^ik^rcu/re y they >^gy^ feel 
^n^^pp6ialj^ts (nhiSft phey^^ personally) 
iPc^^jll^ gS)^^ practtCjoner >^lAn* tk^j^^ know. ^Thcj mal- 
:afij^be> tifef iq^^riiay initially vlead to more. cbngerva<:ive adoptioti or. new 



It wiJ 



r t6 ^tay curr^pt. 



also place tremendous pressure ore 



Despite its many probleins-, however. It Is difflcult^ci argue with the 
inclusion that,\]ieaith R/D&I^has been successful and effective withiti 





in^ '^t^erea in whic 
Jeioplng ^-countri 
ophlsticiated hea 




operated*^ This is even evident in the | 
jfiave benefited from the transfer of relatively / 
echnologies (such as innoculatlon, use of anti- 



biqticis^ sanitation, etc.)* f^^^im the' more developed societies. There 
the reductions in inf^t mortality and increase in life spao from the 
s^t^adicati^n and cure of many previously^ endemic diseases have generatlid 
new problems of expljiding popu^atians, 



In our own/country the social acceptability of the products of l|||plth 
R/b&I, whether in terms of new medical procediri^es, equipment or new 
drugs has been very highi at least until quite recently (when some of 
the 'thodesirable side effects of tl|| new drugs, contraceptives, treatments, 
rfEc./have begun to surface). The fact that theJl^e^lth indusfl^ has 
begup to be plagued by, malpractice suits is lesfff* an indicator of 'falling 
confidence in health R/D&I thatK^f mistrust of ^the delivery and care 
process. yTr ^ ' - < ^ 



4. Economic Factors 



iiWRtlfe economic factors' certainlyfpljay a cru^ilal role in determining J:he. ' 
. ^atu^^.,and operation of the entire ^alth systjjjpJV -their impact upon I ' 

medical '^il^ (by comparisony is relatively ^^light. This is so because 

- ■ . ■ ■ ' '. - ' '''' ' ' • \ 

th^ major fund i% sources for the field (the Federal govermnAit, 60%; 

the private, for |lhirofiir sfctor, 3l|^ are relatively ins ulated- fifcpiu:^ 



but the most lotlg term economic trends. 



In general, the cash available to the Federal government^ is limited by ' 
the willingness of, thie Congress ana Executive to appropr^te f^nds. Al- 
though there are considerable pressured* to limit the absol.if 



in one area \ 



spending/ there is little or no economic reason to'^make cuts 
over another ^;:- . T^^ decisions fall into the political ^rena rather'^than 
the. ecdnomtc; anc||as has been stated; health R&D^^ a%afe political 
issOe. " • . . iL . 



m 
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The Medical Services Delivery System also has been relatively Insensitive 
. to economic pressures . This is somewhat more difficult to explain, but 
basically there are two prime reason^/ Medical^j^j^ervices delivery systems 
^W^^^ described. In general, as a geographically limited and controlled 
market with an inelastic demand. ^ (Pipal ef al. 1972; and Hepner and Hapner ^ 
1973). Only ci^ertaln Institutions and individuals are licensed to provide 
medical services; and entrance Into the field Is. highly pre&crlbed and 
^controlled. The system Is succintly described by Secretary of HEW Califano 
(1977): ' ' * 



"We perceive the health care industry as vlrtdallmhon- 
competitive'. .:The features of the competitlveljoariret- 
place that hMj^;-sexvQd our people so. well In other 
industries "^^^s^T^ efficient allocation and utili- 

zation of reSourc^B^^^ just about •non-iexistent In the 

health care ind^^ry^^ 





The patient ^'^■^fii^^'l^l^^r may select his family 
doctor — ^}^t^^^^^^Sm^^^^ his Specialist, his 
hospital, t m^^Mi^ fSPf^MMi^^lA he needs, the often 
ive medl5al|P^st^:q^^ is subjebted. The 

tX vis the "central declsiiJhi^ more than 

tit ofiheaflth care serviKsV^ >^ ' ^ - 

. 'P^^^-®^*^ ^® consumer ^jei. does not 

Ixfi^^tyyipr the service he (or receivjss. 
ifety g^ the hospital bills are paid by third' 

parries private insuMnce companies. Medicare, Medi- 
caid. ^ % ' 




iBursemen^ mechahi 
^tix^d-fee-service 
icient ways to function. 



Li^Mjoidually operate ^n' a cost- 
bflpP,' the most expensive^ and 



Most* fJSBlic ahdt jgr^ate benefit packages are heav;Ll^ 
^biaseditowaird expensive in-p/atient care. 
' ■ . * t .^ ■ ■ - ) r . A ^ 

The unavailablUtv of price and ^ality informat 
the consumer ojrne^rtnycare ser^^fcas dependent 
decisions of the healtn care provide^r, wljjb play 
ant role in determininjg demand ifor healt^servic^ 
whdjse financial, well-being is determined by the 
charged. 



keep 
the 
domin- 
and 
rice 



i 



^PThe abilffey to restrict access to cdmpetitors — hospital 
credential committees tihat can deny pr ddlay privileges 
to Health Maintenance Organizations , for example provide 
special levers of market control. « 

. ■ ^ ^^^s^. . .. 

These ar^Sd^.^^ tl^domlnant economic features of the 
health care lAdustrjW- features which provide many powerful 
Incentives to spend more, and few, if any, inqpntives to 
spend more effici^tly. » • 

We must face a Basic faSt: there is virtuajlly no competi- 
tiojpi among doctors or among hospitals, Anrf^, "just as impor- 
taa^t, there is precious little competition among pharmaceu- 
tical conpaniib or among laboMtories. For pharmaceutical 

equipmiKt resear^ has become big 



and medical device a; 
business, with pateni 
the research rainbow." 



onopoly pots of gold at the et^d^'of 



ves. In the 



The cotnpanie»-in the health care industry have found t! 
past, in th^enviable. position of being among the most provable in th^ • 
nation. Accordltig to Hepner & .Hepner (1973) : „ ^--i:^ ■ 



;3i 



"Th«e has beep a spectaculaiir boo^ fqriJiiealtW gob^S since* 
1967... In faqj|, this era ha§ been labeled a • gold- rtish' 
by some; ^$2.5 ^bill436ii Iti after^tax pr6fit was^ 

tmade by th^M^iBtry. , 'Stocl*5okers advised their clients,^ 
^jjifc they ^wid see a stead/ growth pattern only In thfei'^ 
health indu|fcy. af^tCdt^itaJr^d with, other Indus trl«| 
Hospltdl suJP^s ffn4,inediQal electronicO^ t|r^glajDor 
stocks of ra69 and 1970. ^^Some of these cTOpajxies ex- 
perienced a profit growth a»Rie^rate of more 'than. 207a 
a year. i)^ugs, however, appeared tp "be one of the most 
profitabfinbusln^sses o%l!ii4^ealth industry complex." 



Working from such, a financi^^sej^tfjl^^l^J^^ in^ 
a position to afford significant exp^tiiB^t0s:i':fSv^VJ^^ 
conditions maybe less favorable. ' r."'^r:^'ii:y'-.i:"^"- ^ 

The otheJlk)% of I^hgWpendlturefi for health R&D com^ from not-for-profclfe-^^^ 
sources normally prlla|#*^0un^^^ and the' valuntary Ijiealtli' agencies , 

HEW (1975 (af, (b)).* Both of these^ijgiirces of funds are qutte sensltiv|^. 
to short-term switigs in the economy. Voluntary heal^ agencies depens| 
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primarily upon contributions ^om individuals to support both their ' 
intramural research and thelivsponsored eSctra-mural projects; and con- 
tributions vary quite directly with individual disposable income. Foun- 
dation contributions are dependent upon interest earned by' the foundation'! 
endowment. For the moit part, endowm^^j^nds are invested In .long-term 
^bonds. The yield on such bonds in a gfffei year directly determines the 
'amount any given foundation will contribute ^ the support of research <n 
in the following year, /HEW (1975b). ^ 



One further point seenij^ig^y note/ for health 

R&D ariB taking up an eyer'incre^ising shar| of the total FeU^al R&D 
budget (Table I) . Because the growing Concern for cost-control in 

J* suggested that the medical R&D system 

Is comlng^nddir cloife# gcrutlny in thi future. * 



, 5. Scientific and TieLChnological Conditions 

-iMI 

The^jB are perhaps -the most difficult factors to assess with,.respect 
to health R&D. The*literal explosiop of information within thg^ past 
25 years ai well as the continued .trend towards speclalizatidii iii all 
parts of the health field makes understafuling the^'^state of-sfetie^a^t" 

a full time proposition. This poses coWider^ble problemff for the # 

^ .-J, - ' ■ _ ' * •' 

policy*maker as well as. the practitioner. 

. - 4^ • • ' 

If,.as hasr been asserted, the question for pql^cy makers is not at what 
level to fuTid medical researc||^ but rather JItiat research to fund at a 
given leve*; it can be seen why the rapid change lf||the medical "knowledge 
ba|^ cau^^* 8l|pificatlt problem. Ubless the policy maker is a current ^ 
specialist in a variety ^of fields, it becomes extreme lor difficult to do 
comparative cost^benefit analyses on research proposal^ As such, develo(j^- 
ing a coherent, integr^^ed research program becomes a most difficult task. 



II. HISTORICAL DEVELOPMENT 



The history of health- research can* be conviniently divided into three 
periods: pre-Worj|lll/ar II, the War years, and World War II to the 
present. The periods "parallel l^te introductory, transitional, and 
mature phases of development of the sysl^era. In general, the phases 
are differentiated by marked qhange in the funding and institutional- 
ization' patterns in the sector. 



■J- 



1. Pre«Wdrld War II \ 'H^J^'' ^ 

The Hitional Institutes of Health had its origin in 1887 when a research ^ 
laboratory was founded at the Marine Hospital, Staten Island, -N.Y. , to 
meet new responsibilities of the Marine l^spital Service. This was 
renamed the Hygienic Laboratory in 1891 ank^ moved to Washington, D.C. • 
Niiie-ye^rs later an Advisory Board was establifetied f6r the Laboratory!^ 
this >fas later to become the National Advisory Health Council. In the ^ 
same year. Congress gave the Service responsibility for control. 



biologies. In 1912 the name of the Public Health and Marine HMpital 
•Seivice was changed 'to Public Health Service, In 1930, the Hygienic 
Laboratory was renamed the National Institute of Health. Congres^/ 
authorized the National Cancer Institute |J|1937 and the first research 
grants were mad|| Hki 1938 the National Institute of Health moved to 
Bethesd^^ Md. I^In this samej^^ri^the National jpancer^Institute awarded 
the firsts Research fell^shi^^rV 'in 1 the Pub 1^ Health Service Act 
consolidated and revise^^existing public health leKslation, and gave 
NIH general legislative authority to ccmduct research. 



It can be stairia with reasonably assuredness that this counti::y had no 
integrated h^lth research and dWelopment p.^gAlcy prior t?o World War iP. 
From the later decadesl of the 19th Centurf^p|>ugh 1941, it was the 
privafte sector rather than the Federal govel-nment which sjup'pprted most 
bio-nedical research. F<ijindations sucji as 'the '^oc^^^^fSBj^j^^^ Carnegie 




/ 



trusts Invested large amounts in medical research during the first 
quarter of this century* In fact, by 1928 the Rockefeller Institute 
had a total endoiiiBem.of $65,0Q0,0^^ and its 4inmial Budget alone was 

* 'vineny times that of the Federel goverinient ' s , (Greenberg 1967). 

•■ ■ ■ ^ ■ ■ ' . ' ■ 

# During the late 1920'Sy however, the situation began to change. Public. . 
health and particularly the problem of q|ficer were^ bec^mit^ significant 
concerns. In fact, cancer was "costing the United Stipes almost $800 
million a year, destroyiim more than a hundred thousand lives a year 
and inflicting more suffering and agony upon the American ^people than 

: . fj^l 'i^^ other diseases kilW to humanity. (Cong. Record 1928). Between 

• W2a 4nd 1930, the United States govet'^eih^^/topirits first major steps 
on the roa<)^x^o becoming the primary support of biaknedical research in 
this country^^ The Congress estabirnhed the National Institute of Health 
as aodUvlsi^ of ttiie Public Health Servlqe and appropriated three quarters 
of a mlllfon dollars to^rect additionltf'^ulldlTig^ to house the research 
effort of the Public Health, Service. . « 

t:JHowev^r, this period was not without its problems, in particular, the 
"question pif Wo was to take the Jllicy initiative in the national health 
r4d system wbs' a tfiomy one. • Initially, it was Congress^^ather than the 
^^$ktyltt^er t^^ shown interest in the public health domain. But vith 

' tke onset of thie depression and th^ election of Fra^l«| D.^ RoQSeveit, 
the sltuatl^ changed. For the next three years tnfere W^^Scxni^^MI 
and countilll^ by varioyis parties^ and lin^^eneral. 



confusija||^about what was hap^e^^ thr^uglHfche efforts of then 

Assistant Sbrgeon ^General Le^isT^ompson, a compromise was reached; this 
resulWia ija Title iri drf the Social- Security Act jof 1935 Which auttrorized 
expenditure^^of Bp to $7,000,000 annually for the Investigation 6f 
"disease ^^ife the problems (Strickland 197?^ These 

^- funds -were dftced under th^ control of the NIK and greatly enhanced its 
position^a the^fleld. ^ig^f^ 
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The finul event of significance prior to World War II was the creation 
of the National Cancer Institute in 1937$ As was previously noted, ^t 
was the cancer problem which had trigg^red^ the inter^t in to 

health during the late 1920^s. From 1928 -^6^93^^^^^^^^^ 

with the support ot cancer research hadBlfi^t^parisi^^ Houses of 

Congress. However, the policy void duri'ng most of those years had been 
•Aan adequate deterent to the passage of any one bill dealing with the 
issue." In partlcuT^'r ,':th^^ was ojipoaed to- singling out cancdP 

for special t^C^atment. The issue came to hb head in 1937, partly due to 

campaign aimed at raising public support for f 
some kind of funding (e.g. Fortune Magazine, March 1937, carried an ar- 

*ticle entitled, ••Cancer: the Gr^^^JUrkn^ss^') . In an unusual move. 
Joint House-Senate hearings were held on all the bi^s then under con- 

. sideration which dealt with the cancer problem. A compromise j^bs reached, 
and the National Cancer Institute Act was passed otKJiily 23, 1937; the 
President signed the bill into law on August 5 of that year^ The Xnstltute 
was placed under the control of^ the National Institute of lj^||th, thus 
fui^lRt^ esicaj>lishlng that" agency* s position in the health R&D system. 

' ■ ' » . . " .. .... , , ^ 

^ The history of the National Cancer Institute Id worthy of note in at leasts 

,f,. ^ ' * ' ■ ' 

three ways* First, it exemplifies j^e workings of the pre-World War II 

\. ■ . ■ 

policy formulation process for jJa|^.^^lth R&D system of this country. 
Political in-fighting, partisa1|^^LiB|Urf. protection,^nd ultim com- 
promise were the'^'brder of 'the day. These conditions^**emained permanent 
until the war effort was to fjrce the country- Into a unif iedposition* 
Second, it established thebpre^dent of creatitiig parBt^far'^effical "In-r 
/Stitutes'* to deal with specific diseases (••Categorical" Institutes). The 
obvious need for coor(^(natfon of research effort was beginning. to evidence 
itself, and the patiterns of ^dfcnstitutlonall^ation which would dominate the 
field in the future we|^ forming. Third, ,it firmly eSwtab-lished the NIH 
^ as the controlling orgOTiizatlon in the Federal Governm^ht's activities 
in the health. R&D system. Althou|;h it^posi^on was\t<?'bp challenged 
later, the NIH was destined to^grow witjtfeeach adiiltlbnal ••ihstitute^^ 
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placed undar Its autfplcM. The National Cancer Institute was the In* 

' ' / '* ' • w 

Mlglital step along that j^ath. 
2. ^941,-1947; The War tkmxB 

Faced with the task of iDoblllzlng the country for war, President Roosevelt 
soon recognized the almost critical need for a #|||^g, centt^lzed policy 
for inedlcfl '!»D.- The newly created National De£«PI Siaearc^ Committee 
was qulckTy proving the benefits to be obtained from such an approach. 
It therefore came as little surprl&e when in Jfuly, 19^, Roosevej^t 
created the Office of Scientific Research and^'Develdptnent (OSRD) . Placed 
under the direction of Dr. Vannevar Btiah, OSRD had two aub-components: 
thi^t^Mnmlttee on Kedlcal '^search (CMR) and the already existent National. 
Defense Research Committee^ ' ^ <^ 

Initially, CMR. was charged with ''mobilizing the medical and scleittClc ^ 
personnel of the nation ... recommending to the Director (of OSRD) the 
'need for and the character of the contracts to be entered Into with 
universities, hospitals^ ;and other agencies conducting medlofl research 
activities, and submitting recommendations, with respect to 4:he adequacy, 
progress and res4|{ts of research on medlifal problems related to cAe 
national defense." (Strickland JL972) . 

CMR lid its-- job well, spending ibme $'>5 wtllion betw^n 1941 and 1947, 
Perhaps most impressive accomplishments •cii^'i.n the area of "develop- 
ment" rather ^^^n research; Such discoveriea;;^as p^^^ and blood 
plasma, wh,ich had existed as labot'atory prototypes only at tfhe beginning 
of t^^ar, *1iad Aeen "brought into mass production. They were widely 
avMliblt^^^ snied forc4ft and on a more limited basis to the bivilfan 
^pgyijatlo^^^^^ well^ Congress wa^ grea-tly impressed; and with victory in 
l1t^^^^^*5Pp^ virtually assured by late 1944, it bilfiin to investi- 




contlnuiiig the centrali'^ed and highly productive medical 
,re5eareh and development policies established during the war* 



Tnere were at least three separate ptM»p«i'is for ho\^ this might be 
accoirtplished. Vannevar Bush, aa^fplrector of the Office of Scientific 
Research and Development, felt thdi a^nif Ktd approach to the |>roblem 
should be taken' and felt that all niderally sponsored R&O (including 
medical) should be controlled by one agfency. However, he was concerned 
that resiearch and researchers not be' overly controlled by^tW Federal 
pureaucracy. He therefor^ proposed the creation ♦of a NUttdnH^ftHticlence 
Foundation as a semi^autonomous organi^at^^oir tS disburH 
research funds. A sacond proposal was to create a m^^^nBteV federal 
agency to^deal jptrictly with matters of healt||i H&P.'^^^^Bpproach was 
auggested by a committee which Bush had rri firi i)p n||^;iiilSj^ lIll. 
responsibility of making recommendations concernl^^^e^cS^^ 
federally sponsored medical researcii after the waadlW^'e third altema- 



tlvfe was to allow the Public Health Seiyice, and^JpHcularlv NIH, to 
assume these responsibilities- With thl end ef iS^war in sight the 
unanimity of purpose concerning medical' R&D policy quickly vanished, 
and a st^alemate ensued for the next few years. 

At approximately the same t^t,' the Public health Service had acted to 
strengthen its own position. In late 1^43, it initiated legislation 



to revise aWPBOns^olldat^e the many statutes ^nder whtoh It then operated 
Passed and signed into law the following year, the Public Health Service 
Act of 1944 authoria:ed3a that agency "to pay for research to be performed 
by universities, hospitals, laboratories , and other public or private 
Institutions," It therefore was given- powers roug^^- sim^|pr to those 
entruatjjjjl to CMR at the beginning of t^ Wats.' The aw J or difference was 
that NIH was to award "grants" while CMR had signed contracts. 

By 1946, CMR was ready to clos^ d6wn its operations- IJowever, the 
poUtic^^^ebAte,on a national R&D policy agency was still deadlo^cked; 
and r^O^ tof^ssume the^^dministration of the ;remaining CMR con- 

tf^ajflCs. Only the armed servji^es* and the PHS wei^e legally empowered to . 
do/this. When the sejvices declined the opportunity , the task tell to 



. PHS and mor^. specJificalXy to, NIH, increasing its budget considerably/ 
During fiscal yeat 194S, NIH let $180,000 in grants; 19^46 saw that 
climb to $850^,000 |as the CMR money-began to' pass over; by 1947 it */• 
handled almost $4 rnillion. With its expanded, administrative dutieis " 
NIH needed moreV personnel and office space. As a result, Congress 
increased the total NIH budget^ for fiscal 1947 to $8 million, up fronf 
$3 million jus't the! previous year/ Thus,- before' the political procesis 
could produce a . solution, 'NIH had tie facto become- this nation^ s adminis- 
trative agency for lifealth R&D, - ' • ^ 

3> The Post War>Yea!rs 

■ • ' . ' i ■ ' ' ' ■ ' ' • 

By 1947 the* broad brush strokes of the national medical R&D policy had 

■ "\ ■ > ■ •■ il 

been «st^>blished, Hpwever, the issue of a total national health policy 
was stiU up iu thb air/ Clearly, one was needed. There was growing 
public interest; in ar^d* contern about this nation's health practices. Ah 
active and competeht ihealth lobby had developed and was pushing for major 
legislation on- numerdus fronts , the two most, controversial of which were 
a national* he^th ^insurance program and direct federal support of medical 
education in thife country. 

While these issues were generally viewed with favor by the public, there 

was one- important organization which was flatly opposed: the American 

Medical Association! Vehemently opposed to any attempt to "socialize" 

medicine iff this country, it lobbied in Congress and carried cut a massive 

public relations campaign to persuade the public to'^siipport is position. 

Because the national .health insurance program was such an integrated part 

of President Truman's proposed health legj.slatjLon, the entire package was 

left in limbo, ^^e same time, public preissure for federal spetfding in 

healtJi continued ncrease. ' There was oi\ly 'pne pl^ce for those federal 

dollars to go: Research and Development. By 1954, the NIH budget had 

■ ' • ■ ■ ' . ■ ■■ . • 

skyrocketed to $71 million. At thap point, the momentum of the system-^ 

' ' ' • { ■ ■ > \ '■ ' *" . • 

had b^en established and expenditures c6ntinu,cd to rise* 
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At least in part,. this was* due tp'^ general , belief that if ^ little\ 
money did some good , -tnoire money \dad irtore ^od . The am^/Jng success of 
the war tim^ medical R&D operaCibn .had convinced people that iJith '^proper 
funding, medical miracles awaitfedl just around th^ next corner. When they * 
were not immediately f^jrthcoming , \ the poli-cy response was simply to in- > 
crease funding. Further, medical W&D had^ become a "growth" industry. ^ ^,^>^ 
More money brought in more researchers who needed ever I'ncreasing amounts 
of support. Thu[s, the basic charadtet of the system was established ^hcl^ ^ 
to a greater lesser extent continues to this day. , \ . 

A/new dimension was added to the heajlth R'D&I systim in 1968 with tWe 
founding of the Natipnal Center, for Health Setvices Research. ' The* Cehter 
ti/ent through several reformulations culminating in Public, LavT 93-353, the^ 
"Health Services Research, Health Statistics, and Medical Libraries Act ; ' 
of 1974."' This legislation authorized the National Center to undertake , * 
research, demonstratt6n. and evaluation activiti^ with re!|||ect to the 1 . ; 
delivery o| health care. Th4 concerns of the Center are how the health J ^ 
services del i^>'ery system ife structured and how it operates and on- it^ 
success in ^d'elivering health care to the public. It seeks tp "improve the ^ 
effectiveness ^nd effipiency of th^^ system thr^gh an understanding of ; 
knowledge >produ6tian ^nd knowledge, utilization behavior . anc? throi^gh i * 

developing and evaluating new methods of \ producing, funding and prcJvid^ing 

I / ^ , • ■ '\ ' * ' • ". ' . • I 

healthyservices . ' . " . \ ' ^ 



Org^tii^ationally- it is part of , the Health Roj^ourceS Administration within 
'the^ Public Health Service in HEW* Its'fufidVng has fluctuated from ap- 
pproxima^tely $1% to $'>5 million. Some of diei general program areas are: ^ 
'(quality of care, inflation and productivity, health care and the dis- 
/ ^dvant'-'ged , personnel health,** health insurance planning and regulation, 
/ and emergency medi9al services. A number of Health Services ReseaVfh 
/ 'Centers have and are being, set up. These /consist of both "generalV 

and "national special emphasis" centex^s (e. g. , in health care^ technology 
and in\he.alth care-management). ' ' . ' . 
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4,' Health Delivery System • . - ^ 

Some additional thoughts on the health delivery system are in order. It, 
should be remembered tha^ it is not a system that has been designed. It - 
is rather a conglomerate of providers, consumers, organizations and 
finance mechanisms that has evolved over the past 100 years. One must 
understand also that the present health services delivery system is at 
\east' as "disease" centered as it is health centered. Numerous indicators 
point to this conclusion; but perhaps the most important is the manner in' 
which the system* allocates its resources* Approximately 40% of all ex- 
pend i^^u res ..in the fia^d are for'direct hospital services. (Knowles 1970). 
And the nopms of the hospital have been dominated by a medical toncept ^ 
rooted in "curing diseases and disorders, not preventing them." (Zald 
and Hair 1977). Doctor * s service's, d^ugs, and dentist's services account 
for artbther 377o of toffial expenditures ; and it seeras'^^asonable tp assume 
, that 'the majority of these funds al'^o is spent for diagnosis arid treatment 
rather than prevention or health education.^ (Knowles 1970),' 

,It is .probable that this state of affairs resulted quite directly from 
the *infusion of new technologies and practices into the services <system , 
during thq later half'.of the nineteenth century. Coe \1970) states: 



"it can be argued that modern medicflne began in . > 
the nineteenth century. This was the elra, especial- 
ly ^he later half, when a bewildering ^rray^ of inven- 
tions and discoveries wag. rtiade arid used as^ 'auxiliai^ 
means of getting at the^^^nternal environment*." 



^ Further*/ He links this devfelopment of new procedures a*nd equipments to 

*■ ■ * • '■■■.'*■ ■ ^ ' * * • ■ 

>^change in 'the orientation of ^the hospital. 

i "Prior to 1900. most hospitals had the avowed 

. . purpose of serving all wfoo sought admittance, 
* \ especially the poor and the sick. With im- 

* ? ^ . ' 4 proved medical care and its attendatgH|||)pi«e in. 

^ ' ^-^^.^^ _^cbsts,* this goal was altered to thos^ who ap- 

^ I ^or care but were not ^dependent upon ^ 

}/ publfc\:harity, and finally, hospitals were 
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geared to cater to those who desire 
hospital * treatment in preference to 
hoiT)e care and who were Vg>)undantly ' 
able a^d willing to .pay /6r treatment./" 



No conscious decision to center the sy3tem around diagnosis and treatment 
wasf eVer Wde. ' Rapher, ec(y;iomic necessities and the state of medical 
knowledge in the late 19th century . combined to determine the basic 

character^ of the system. This state of affairs has not changed signifi- 

• ■ . * ' ■ . 

cantly. Coe continues: 

J' - » . 

"the .modern hospital has become the focal point 
of the/jcdmmunity' s health care-. In part, this . 
trend . V^s &tiinulat^d by technological discover- 
ies*. *More significant for contemporary medical 
practice is the development of expensive and i 
* highly complex diagnps^tic and therapeutic in- 

strumAits, which only a laijge organization such 
,A ' as a hospital could afford'to own and operat;e.'! 

■ ^ ■ '^.^ ^ 
This particular organizational patt^fi has impacted the health R/D&I 

system in three ways. .'Fii;st, hospitals are the primary "customer" of the 

R&D system; because the hospita^^^ s j^oncertis center on dii^gnoeis and 

treatment rather than prevention and education, most R&D dollars are also 

invested rn. th"^esey areas. Second, hos{Jitals are geared 'to high technology, 

xomplex-S'oluoloTis to health problems; their vepry reason, for existing is to ' 

act as a technology" center. Therefore, the R&D system has centered upon 

^ . . . - < 

producing high technology answers to the questions under consideration. 

Thii^, and perhaps most important, these trends have resulted^* in a very 

Ihi^^gree of functional' differ^ ?M*ation/specialization. Xt the ijresent . 

Itime there are over 13,000 medic i Health journals in print; and' the vast 

' ■ 

majority of these are specialty journals, 'There is in fact not one health 
R^D&I system, but rather many micro' R/D&I systems, each of which serves 
a different clientele and works in a different area* Except in so^^ar as 
all' segments are funded from t^he same source(s), these systems operate^ 
ind^pende^it of one another, with'little or no attention paid* to the problems 



f 



/ 



ERIC 



V 




of integrating thiese knowledge sources for the individual p|facti- 
tioner. The "information overload*' which results is one ofl the most 
pressing problems .facing the , health system as « whole at this time 
and is a topic requiring impx^rtant policy consideration. (Rutstein 
196 7). - 
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III. INSTITUTIONAL BASE 

1. Structure of the System ' 

The basic structural components of the field are funding sources, re- 
search settings, producers (some of whom also.eVigage in R&D), contrq^^ 
organizations, users, support organizations, and ultimate consumers. 
Basic research, .applied research and technoi\>gical development each 
have their own system of components; but for simplicity, structural 
components for all categories will be presented together, as is 
indicated in Figure 1, 

While this certainly presents an oversimplified- picture of the field, it 
does indicate the basic dynamics of the system. Funding sources provide 
the resources for all three categories of system operation. Applied re- 
search is funded by all four sources; technological development primari- 
ly by private industry; and" basic research by government, foundations 
and the voluntary agencies.- Researchi^rs utilize these resources to 
attain the goals of their specific category and channel the results 
either to a producer (as in tHte case of pharmaceuticals), to users 
or t6 researchers in -the other categories. Support organizations 
nrpfovide pblitical, social and organizational functions , with the 
insurance companies acUing to make adoption of sophisticated 
procedures^ anid equipment possible by spreading the usually high 
cost effects oyer the entire population. , . 

2. R/P&I Institution Characteristics 

t» . • • ■ 

The vast majority of biomedical research performed in seven institu- 

^ . ^— ^ 

ional settings: universities (predominantly • medical schools); private 
ndustry; ' federal research institutes; private research institutes; hos- 
pitals affiliated with medical schools (''teaching hospitals"); federal 
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Funillnf! Sourc|!B 
Cottrnmcnt (607.)* ! 
Private Industry (30Z) 
Foundation (570 
Voluntary Agencies (57. 

V ■ ■ ' 



Users ' 

'.Health Care Providers 



-jShyslclaris 
-dentists V 
^hospitals ) 
•clinics 



8tti)Ctural Coinponents of the llenlth R/D&I Field 
' FlKure 1 



RoBQArchers 

" ' """ ^ 

Fcderfll Institutes' (8Z) 
bnlversltlej (26:) , 
Industry j32Z) 
Hospitals (2??.) 
■voluntary, state, local 



■Federal (307.) • 
-medical School (361| 

Other (77.) ; 

Uitlmate Consumers 
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percentage of system resources utilized .per annum 
Source of data; Derived from Nltt Almany 1974 1 (1) Resources for Healtlr'RiD Report No. ^""Resources for Bloraedteal 
Research in Education," Nov. 1970; A) No. il""VoIuntary Health Agency Support 'for Health Research and Development,'^. 
Sept. 1975; (3) No. 22--"U.S. Priv/te Foundation Support for Health R&^^^^ . 



hospitnls; stale hojrpltala; community or public, non-profit, and for- 
profit hospltnls. Given tht; evident cllvorsity of thcvse settingH, it 
is sor^ewhat r.urp4risinK that the absolute number|y^f institution? - involved 
"in research i55 not larger* For example, in 1967 only 524 out of 5,700 . 
of this nation*s hospitals had active programs in biomedical research, 
but only approximately 1,400 of these •'were over'' 200 beds . Fifty-one 
of all hospitals accounted for $136 million in expenditures--over two 
thirds of the total for this type of organization. fHEW 1970). , . 



In 1970, this country had* about 100 medical schools. If we combine. w 
those funds' allocated directly to these organizations with those funds^ 
provided to their subsidiary teaching hospitals, another 36% of tc^tal ' 
system [expenditures are accounted for. Therefore," over 40% of all ex- / 
penditures in the field can be accounted for by less than 160 organiza- 
tional utiits . ^ " 

Ip terms of funding sources , the Federal government* undoubtedly occupies 
the premier position in the field. Most Federal funds not spent to 
^support the' government * s own research programs {low through the National 
Institute of Health. Primarily thes>e funds are used, to provider grant 
monies to non-profit organizations and to pri^vate institutions working 
in research and medical education. NIH also supports- the diffusion pro- 
cegs in basic researc*h by sponsoring the programs and activities of the 
National Library of Medicine. 

NIH is comprised of tvjUlve^ research institutes in addition to 
^ cotmon, central research hospital; a* divt^ion of research grants 
for quality review of extramural grant activities; a research 
support division for its pwn intramural research activities; a 
division for extramural research resource pr^Dvision; a division for 
international activities; a division of computer research and tec>i- 
^ology; and the National Library* of %dicine ^xth its own extension 
and grant activities* 
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— Thxr -mwHi Crt l-;Jtrtr£tTti?^^^ ; 

inva,lV(Hl in and maintalufi fitronn coiU;ri)lf|i uvt-r all phaHt!!i ol' the R/OM 
procrnn. Wh«itht*r thu ron^arch la cnvvlvd out in trtlcral liuit ituLoM , 
utttvorn L t le i or drii^; companioM tlui work musL bo ultiinaLuly rvaluat(?d 
and logittmalcd by M.D.'h. While much of the research may be conceived 
and carried out by chemlntn, biochcimisLs and oven enginee'rji, Lhe fun- 
damenta^l rate and direction of reHcarch is M. D. -determined , ofttsu 
Icadinti'to significant tennions and clashes between the Ph.D. and M.D. 
personnel (whost^ status isu-ftcnorally much higher). This infusion of 
the medical user profession into the research, development and evalua- 
tion phases even, for example, reaching into the control of support 
institutions such as Blue Cross, ^is a significant characteristic of 
Health R/D&I making va neat linear specialization description a 
poor model of the system.' This issue is compounded'^jy the fact that 
tnAny innovations techniques and even minor ^equipment will derive 
frqm the day*-to-day experience of medical practitioners. 
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IV, GOAL S, POLICIES, AND STRATEGIES 

^ '■ O % i. ' . . . '■ 



The goal of the total health* R^D6ct system can be described as the 

• creation^ of the knowledge, techtiiqSes, and products necessary to 

improve th^ ^^state of health o± the population/ This is to be done 

/ ll^.preveVition when possible and, failing that, by diagnosis, treatment 
* • v ' ■ " • . • , . ' • ^ . . 

and "^phabilitation. However, to whatever extent the- various functional 
V ■ ■ * . ; » , 

/stages of this system are discrete and independent, this pverall goal 

.. . becomes manifest^ed in the more ^specif ic sub-gctels and policies of each 

such discrete functional stage of activity. By discussing the goals 

and strategies of three significant functional stages of the syste©, ^ 

the overall goals and, policies can be inferred* The three stages to 

be discusse^f-d^: basic research, and applied research which map into 

our research feature; and technological development. 



The first, but not necessarily the largest, category -is basic research* 
Here the ^problem is to understand the basic fimctioning of. the biologic • 
and pjhyslbiogical processes. An^example would be how genetic information 
as transferred from one generation «to the ne:ft in the molecular structure 
of large protein molecules. This knowledge i'te then used to afid applied, 
-researchers in their attempts to deal with specific diseases. Diffusion 
is accomplished through jcxirnal publications, conferences, etc, 

Probably the larg^t ca^^egory of activity is applied research. Specific 
diseases are investigated either to «Lsplate potential causative* agents 
or to djsvelop ameliorative techniques. The criteria by which a given 
techfiique is* evaluated^^^^t^^^ased almost solely on effectiveness consid- 
erations. Because demand is not prite isehsitive,. cost and efficiency 
are not vital concerns* Rather, the absolute probability of success- 

- ful treatment (no matter what the cost) is "of ultimate importance. 

» ■ • * ■ 

The cu3tonier,s for the results of appl4.ed research are not health 

■ ■ ' ». • ■ ■ " • 

care coasumers directly,' but rather the practitioners in the field.* ^ 

' ■ . ...... 
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^ Physicians, hospital administrators, and publiq health officials make 
the ultimate decision oh which produ^cts ahd servi^ces will be utilized./ 

, by. the consum^l:. TJh'e main diffusion stirategy of^ this segment of the 
• >field, therefore^ is to convinces the iri(4iTj^d«al health care provider 
^ 'that t?he o^rinovation is more^f fect^ive than v^^tever is in use at the '/ 

*. present time. ' ^ . ■ , .^v 

^ Technological development ' is the'nexjt most sictive^ category of^ndeavor. 
It consists of research on ways to supplement, improve, or automate 
established tecTiniques, Examples of thiS' category are advances it^ 
medical e;lectrariics ^uch as intensive care moriitoritig equipment), 

. infra-redVjnammography (for detecting breast cancer) , the use of va'rlous 
radiation sources for therapy, and computer; assisted health information 

' systems* ' The major customers for these products are ' hospitals , clinics 
and research facilities. The majoy developmental strategy is to adapt 

. existing^ technologies t'o specific health problems. The dif fusion . 
strategy consists of the effectiveness arguments as previou^y presented 
And what might b6st be described .as a Vpres'tige" approach. / Hospital 

.^ccr-editafcion arid standing in the field are closely related to the range 

, and quality of hospital* facilities. (Zald and flair 1972)* Therefore, 
the desire to 'Ikeep up witli.the Joneses" becomes an imp6^(^ht motivating 
factor. in the adoption of innovation. 
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V; ADMINISTRATIVE PROdESSES 

' '■ ^ ' * 

The environment, of institutions in tfhe health R^D&I system is typical 
of tliat faced by most R&D organizations. Uncertainty and decision^ miKi,* 
under conditions of partial information are the n6rraal 'State of affairisT. 
Therefore, management must reiflikin; flexible if it is to meet the demands 
of changing condit^^ons. Furthefmofe, because a sizeable proportion/of 
these organizations' employees are "professi^onals", it is not uncommon 
to find the dual ladder form of organization structure in'use. /ThJ^/ 
practice allows the scientist to advance in status within the jjrganiz^^ 
tion without having to assume responsibility for administrative detailsT 
This seems particularly well suited to the health -field bemuse the / 
prelt^minary stages of the R&D process musLt usually be per/ormed under/ 
the supervision of the physician. It is, therefore, useful to have^such 
an individual in a position of authority while having^^ftis/her administra- 
tive counterpart handle the details of operation. Tliis does not imply 
that there is harmony between administrative and m^ical personnel. To 
. the contrary, cine\of the central management challenges is the resolution 
of conflict and friction between these R^D&I system participants. 

The administrative characteristics of funding sources are also important. 
The Fedetal .government supplies over 60% c/f all funding for the field and 
faces an enormous control task. The sheer size of the Federal organiza- 
* tion makes communication and coordination difficult and unwieldy. (Coe 
1970). Even though the majority of^unds are controlled by the National 
Institute of Health, other government agencies <^isburse almost a total 
of $1 billion annually. Under th^sh conditions it is not surprising to 
find some duplication of effort ^nd some inefficiency. Also, administra- 
tive costs .for the field ate ^infcreasing; this problem is particularly 
important for the voluntary^ healtlv^agfi?<icies where t;he majority of iqonies 
collected go for administrative cos^s. (Lasagna 1963)* 




The conflicts between M.D. and Jph-D, researchers' has already been alluded 

to. The ptob'leins of interface management would -tend 'to he critical but 

this is somewhat, allevrated by the r^^tively close arganizational 

proximity in which they often work. Nevertheless this^ is a major c^use 

of friction in many health R6cD labdratories • ' * 
• '« . * « • 

■ ■ ' ^ - ' - •'.■•>*■ 

Health planning, generally based on demographic, ecological, economic 
and legislative bases is a develpped amd growing area. Less evident 
is the type of tjjfechnological , forecasting known to 4-ndustry. In health, 
the rolie of the "health systems" expert baSed on experience in the field 
seems still to be the basis of much of the conceptualization and pXan- 

• ■ • ' . , • . ' V / ■ « . ■ ■ - 

ning outside of the above mentioned disciplines, 

*■ 

. ■ ' . ' " ■ ■" 

By and large, projects tend to be relatively small. While a great deal 
of work teay l^e going ton, frequently in parallel and potentially pointed . 
towards a single application, the large scale integrated project of the 
NASA Apollo variety^ with thousands of people contributing small 
elements -to a total system, is not part of the health R/D&I scene. 

There has been some concern in recent years whether the proliferation 
of the disease-oriented, categorical organization of NIH was appropriate. 
It has,. in the words of the President's Biomedical Research Panel, 
created two challenges to management: 

(1) an ever-increasing span of control for the Director 
of NIH; and 

(2) a need to assure that this structure does not limit in- 
terdisciplinary research at a time when all aspects of 

^ research whether fundamental or applied are increasingly 

, interrelated, . 

■ ■ * ■ ■". 

The Panel recommended that if new programs were established or if existing 
progra^ns were strengthened it should be done tlirough the present Institutes 
rafher than the creation of new ones, I^t went on to suggest that tlie 
Director of NIH consider the consolidation of related Institutes into 



« larger units. It was i^elt that^this would decrease the spati of manage- 
,ment, » ' / ' . • ( . 

/. ' V. " • ^ . - . ^ •. • 6. 

■^"^^--^ • ^ ■ . ^ . . 

One of the oSier organizational ^sues that the Panel looked into was 

the special ^organizational status of the National Cancer Institute. " 
There was great congern when the National 'Cancer Act of 1971 was 
passed th^t- the authority to submit its budget directly to the Presi- 
dent would have a deleterious effect on the overall research manage- 
ment.and success, Strickland (1972) comments on this: 

H Organizational' arrangements can affect policy outcomes, 
bu^ the degree to'/which varying organizational foirms. af- 
fec^t/the conduct of scientific research is not precisely 
meMurable,^'especially if policy goals remain somewhat 
comprehensive and operational ethics remain constant. 
Thus it is entirely conceivable that the establishment 
of a separate cancer authority would nat radically have 
changed the nature of the American bioscientific enter- 
prise, even though it probably would have. changed 
dramatically the present government research support 
structure. Whether or not the new cancer research 
money was finally housed in a new independent agency 
or remained within NIH, certain traditions would have 
remained the same: * although much of the money wou-ld 
be spent for contracts, many if not most such con- . 
tracts would be with academic institutions; - * . . 
The creation of an independent cancer research agency 
outside NIH inight have made some marginal difference 
in the degree to which some researchers reprdered the 
emphasis of their work* But historical patterns sug- 
gest the probability that, even if some scientists 
followed the new cancer money to a new agency most of 
them would change the titles of their proposed projects 
rather than the fundamental questions they wanted to 
investigate. 
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6 ent itled "/Personnel NQed«.'^£^. Training ^or "Bipniedica^l , ^ 
Res.earph," They M^ere giV&f^ra6i!job by Congress to 
anion's overall heed fbrJ biomeilical-' and behavioral 



VX: PERSONNEL BASE - ' ^ V ^ . ^ f?- 

W ^ • . \ ■ . • ■ ■■ . , /. 

Tln^ N^ational Academy of; Sciences/National, Research. Council completed 
a report iri 1976^ 
and^ Behavx'^orr^l Res 

festablish^ the natjsi^' s overall heed fbrj bioi^dical-' and behavioral 

research personn^ji^b^^ all kinds/ The prefacW describes the under ly- * 

ing dif f iculty^*^ the study: "Central to all <>^these efforts is 

the fundamental issue of the degree or extent to which it isVpossi-\ 

ble and useful to de'fine and establish human resource requirements 

for increa'singly fine fields of specializati1& within the biomedical 

and behavioral' sciences In the final analysis the personnel are « 

■ ' / , ft 

the intermediate ^ "tal of research. The finals goal is the generation 

of ideas and research that wil,l result in improved health* "No 

calculus exists for "describing relation of numbers and quality of . 

people to numbers of useful ideas," 

... J . 

It is extremely difficult to estimate accurately even .th^ total per- 

sonnel base presently utilized by ttf^ health: RYD&I system. As 

opposed to the aerospace industry whose activities are clustered in 

a relatively limited fSSmber of large tfrganizations, health R/D&I 

takes place in many contexts and over a^broad range of topics. As a 

result, health R/D&I Ts-^not groupe^i^ as a $ingle area in any of the 

• • _ • .„ . 

statistical summaries that are readily available. While, quite ac- 

curate information on various sub-components of the field is available, 

total figures are not. 



For example inxl9'67 state, local^jy^nd Voluntary hospitals employed 
21,823 persons in R&D. Of vl^tj^ 12,459 ,(57%) were classi- 

fied as professionals, Also^ these organizations had 6,178 principal 
investigators in their employ — approximately 157c, of the 42,000 
total for the field, (HEW 1970), If we assume that these ratios . 
hold constant' across the entire R&D system, then approximately 
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ns were 



r 



\ 150,000 persons were employed in 1967. Present estimates place the 

toYal. number of 'profes-s'ionals in tke field at 85,000. (HEW 1973). 
^ (It should^ noted .that these numbers "refer only t'o those individ- 
uals actu/ally involved in the R/D&X procepis^ other hospitsTl &oxt. ' " 
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plpyees and production workers in the . for-profit firms are s^cificiy 
excluded.) ^ * w 

■ ■ ■ • 

• We have already commented da. the importance of the professionalism \ 
of health R/D&I personnel,- whether these are in ^e KP or 'KU dl.men- 
. sions of the system. In fact this very professionalism often makes ' I 
> it meaningless to attempt to separate these roles. Physicians^ > 
particular operate with great ind€i;^ndence and are likely to create 
personal innovations, ftiiany of which a^e therefore never diffused. 
The professionalism, with its) licens^ing and status ^differentials has 
its dysfunctional aspects. Without the proper legitimating characters- 
is tics few can hope to be allowed to cont^bute to the R/D&I process. 

One personnel base ^f ficulty of the health regulatory system and 
its interface with tiie research community is its lack, of attraction ' 
for- the best scientific minds of the. country. As Berger notes: 

RegulatioJK for health has ^ndt been a strong focus for ^ 
best scientific mounds ih the country. Regulation is charact- 
eristically con^iroVersfial, making it, unhappy territory for 
traditional academics. It is seen to be heavily populated by 
laxTyers and filled x^ith political, overtones. Those scientists ^ 
- who have, approached have, on occasion, found themselves ^n- 
wittingly garrpunded by the turmoil of public controversy and 
emotion and badgering by the public press. Further, the 
' a; ' quality of the 'scientific enterprise behind regulation in the • 

v ' past ^ has not seemed particularly sophisticated or challenging — 

' inevitably .bordering on applied science. (The irony here, of 
^^^fe ^ . cours^^i-s that it is precisely this sophistication of scientlf- 
%:#tJ^ insight that js needed in this area.) Finally, and perti^s ' 

* ' ^ost important in programmatic terms, is the perceived lackybf 



research monies from the rjaulatory agencies . 'FMs, t6o7--i:s 
a circupr argument. >The^^e that scientists, ab^nt themselves 
from thk affairs of regulat€ry\agencies, the less Lupportii these 
agencies Will be able to gather^ internally for thiir own ^re- 
search anq development pro-am at the time of budletary reviews. 



* ■ I ■ ' ' ^ 

KP: knowledge production. KU: knowledge utilizati&n. ■ " 
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VII. FUNDING * - ■ ' , 

"■\ ■ ' -J- ■ • 

Sinc^ funding, nas been reviewed, in some detail in previous features 

a major restatement here would be redundant. ']Cherefore in a brief 

summary we note that-Tfundiug for- the field comes*'from four main 

Sourpes: the goverpinent, private industry, charitable f ouigtdations , 

^ and /vpluntary health agencies. The federal government supplies 

apAro^imiately 60% of»all R&D monie§, private industry 307o, and, 

foundations and the voluntaries contribute 5% «each. Total system.- 

expenditui'e's^ r.eached approximately $3.5 billioa in 1973 and have 

refined near.iy constant since that time (correcting for inflation) 



One significant aspect ojfythe funding pat'tern3 for the field the 
dominance of Federal Monies . ' Not. only does the Federal government 
supply the majoi^ity of ali, funds, but it*is effectively the' sole- 
supporter of basic and clinical research. " WhileVj certain spec- 

ialized ar^e^s receive" support from pri^te industry <eJg; pharma- 
cology in the^oase of the drug firms) , most bailie and clinical 
research is intended for a non-paying market: tlie practicing 
physician and technological developi4lnt. As such y the Federal 
government is th^ only reasonable source of fiinSs^. Nevertheless . 
the medical profession maintains a dominant influence' on the dii^ec-' 
tioh and focus 6f this spending. ; " 



. VIII> INFORMATION FLOW , ' . 

' ■ ^ 

With the exceptioa of that work , done in certain bighly competitive 
sub -sections of the fot-profit firms, informatipn flow within the 
system is open and- relatively effective. Over 13,000 professional ' 
journals act ^s relatively quick means of disseminating information. 
A National Library of Medicine was created by Congress ±n 1956 
to act as a central repository and clearing house for information 
in the^^^fi^ia^ additional funds were appropriated in 1965 allowing 
this organization to finance seminars and /^lectures at various sites 
across the nation. ' ' ' ^ 

' In addition to this formal information system, informal communica- 
tion in the field is extremely high. Hospitals ii^olved in re- 
search traditionally hold seminars and colloquia for their staffs. 
And, as previously noted ,^ cooperation between different research 
cities working in the same problem* area is commons 

One problem concerning information flow is its sheet volume, the 
1958 Cumulative Index Medicus listed 60,000 articles on health and' 
medicine (Rubens te in, 1957). The number is approachinfp300,00d 
annually. This literal explosion of research findings makes it 
difficult, i^^not im^possible, for the conscientious practitioner to 
Stay current in his own field, let alone related disciplined. Add- 
ing to this problem has been the development of the "specialty 
journals." These publications are intended for quite specific' 
audiences; and, ad such, the general practitioner or specialist in 
^ome other area may find them all but incomprehensible. An addi- 
tional important new dimension to the processing and distribution 
of information has come from the growth of computer based informa- 
tion systems. 

Some recent work in the area of knowledge trans fer^'was done by the 
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President's Biomedical Research Panel when it looked into the pro- 
cess and time required ''for the transfer of scientific innovation. 
The panel looked' a,t the results o^f two studies that measured the 
timje it^took a iSaboratoty discovery to widespread^ clinical appli- 
^ cation. "Between the years 1951 and 1974 for the cases studied, 
a median durlitiion of SQven years characterized the period between 
the concept for the applied research and the application to -clin- 
ical medicine." Further, it was the Panel's finding that the 
time for the transformation ha^ shortened considerably over the 
years. It went on to point out that the "two factors tltiat seem 
to expedite innovation were the availability of an adequate science 
.base and the degree of interest shown by the research community,^- 
as indicated by the number of investigators working on the sub- 
ject in parallel or in competition." 

A Senate subcommittee on Health and Scientific Re!Search was re- 
cently looking into the transfer of knowledge. As Senator Kennedy 
(1977) noted in his, opening statement: 

We have seen in recent years an un|)recedented explosion in 
our understanding of biology and of disease. The research 
. community is often criticized for failing to ' transfer %this 
new knowledge rapidly enough from beach to bedside, from 
laboratory abstraction to practical application. This is 
the problem of 'technology transfer' about which we in the 
Congress have heard ^o much of late. 

/ 

He went on to say: , . 

This alleged 'lag' in the translation of knowledge from bench 
to bedside is one part of the technology transfer problem. 
But there is another side^ to that problem, ^ dimension which 
also has its roots partly in the productivity of our research 
establishment. It seem^ t^hat, while soi# new medical tech- 
, nologies lag in their/ translation from bench to bedside, 

others leap into application top quickly. With the quickening 
pace of biomedical research, we have seen a proliferation in 
the number and kinds of health practices and procedures to 
which patients are subjected. Some of these new Jt^'echnologies 
and practices, it seems, have found their way into widespread 
use before their efficacy and safety have been established by 
careful scientific testing. We have seen this aspect of the 
technology transfer problem in tlje example of the CAT scanner, 
which has come to symbolize the unplah^d application of new 
clinical procedures in^this country. 
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The CAT (computerized axial tomograph) was cited as an example of 
how technology develppment and use aare influenced by a lack of 
governmental action at a .1976 C9nference on Health Care Technol-* 
ogy and^uality of Care. 'The C^se of . the CAT scanner for instance 
how a new technology ^an quiekly become part of the mainstr^gte of 
medical practice when no check points exist in either the deveLop- 
ment process or in its use in patieAt care." The problem results 
from the fact that- those involved in producing find using CAT 
scanners 'iare not required to evaluate their benefits in relation 
to other diagnostic tools, it is unlikely that they will carry out 
tlie kinds of studies that are needed to determine whether utiliza- 
tion, restrictions are necessary. 

The policy monograph went ' on to recoasnend: 

1) An expanded role for the NIH to includjB responsibility 
for technology assessment through the establishment of 

a new Technology Evaluation Office in the NIH Dl^rector's 
Office. 

2) That 4 new Health Tfichmjlogy Policy Office be established 
in the Office of ,the ^ss't . Secretary for Health.' 

3) The new policy board in the President's Office of Science 
& Technology 'should have two major responsibilities in 
the' health technology area: ^ * 

a) The board shouJLd monitor the reorganization "of the 
'Federal government's role in health technology 

policy; 

b) Serve as a forum to help resolve difficult technology- 

■ / » 

related policy questions. ' , ' 
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IX. » INNOVATIONS 



The life and death aspects of medicihe hdve k significant 'im- 
pact on the characteristics of the innovatiotia. Quality and 

, ' * ' \ 

safety are essfential. Reliability is critical:. Medical in- 

novations are generally complex. The testing requirements add 
substantially to the costs thereby requiring broad scale ap- 
plication of innovations developed by. commercial iirms . 

A discussion of the nature of the product at this point would be 

^. ' . ^ \ ' ' \ i 

redundant* It has been implicit acrossvthe details of each'Of 

... , • 1- \ ■ 

the featur.es reviewed above. However it would be useful to enu- 

■ \ 

merate' some of the types of innovations that might: be involj^ed in 
the R/D&I process in health. 

A complete listing of recent innovations in health R&D is \ clearly 
unfeasible; however, a representative sample is provided to sug- 
gest major thrusts in the field* As previously indicated, three 
major sub-sectors of t^ie field can be delineated: basic research, 
applied research, and technological developments 

Basic research leading to innovations occurs in most rVf rV^f^ li^** 
sciences and some clinical disciplines. For example, an intensive 
study has indicated that some forms of cancer are viral In nature'. 
As such, it should be possible to develop vaccines (an applied re- 
search activity) which would provide protection from these cancers 
Another area of considerable interest is the operation of the auto* 
immune response. Understanding this process promises an increased 
ability to: ' . 



1) diagnose diseases more quickly and effectively, 

2) control diseases that have, been contracted, 

3) lengthen the life and reliability of surgical impliants* 
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Applied research focuseis specificly on |he clinical aspects of health 
care. Exampleat of this activity resulting in health care innor 
vators include the recent development of a rubella vacc£ne,^r- 
gan tfansplai^ techniques, .and the. continued exploration of a wide 
range of pharmaceutical agents (e.g. chemo-therapy for caa^er, broad- 
spectrum and specific antibiotics, drug therapy for pisychiatric.' 
disorders, etc.). Also, developments in rehabilitation techniques ^ 
Including the use of mechanized prostheses would fall into this 
category. 



The technological development area has provided a rich source of 
inxiovatlons . Medical telemetry has advanced significantly; the 
"Automated monitoring of vital signs ia the intensive care setting, 
remote monitoring of vital signs from etoergency vehicles, and the 
recording of Cardiac functioning (fey a device the size of a pack 
of cigarettes)- during the norcnal work day of the patient are all 
repent developments. Sophisticated computer techniques develcJped 
by NASA to enhance the resolution of photographs taken by the 
Mariner series ^of space probes is now used to impifove the quality 
of diagnostic x-rays . Infra-red .techniques aid in the early de- 
tection of brej^st cancer. Automated processing of laboratory 
tedts (e.g. by the SMA-12 blood analyzer) provide quicker, more ac- 
curate, more reliable and less costly diagnostic information to 
the physician. 

Eventually the import and benefits of health innovations are en- 
joyed by almost all members of American society. The net result 
isi . longer and healthier lives. 
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X . NEEB IDENTIFICAT ION 

The nfjed identification process for health .R&D works on foi^r separ- 
^ ate levels, reflecting the three categories of activity within' the 
. system (basic research, applied research, and technological develop- 
ment) , and a division in applied research between commercial and 
not-for-profit activities-. In basic research, priorities are set 
by -examining two" factors : the present states of the art in biology 
and. the physical sciences and the most pressing problems in clinical 
research. Fot example, theories had been 'advanced that the majority 
of cancers could be traced to gertetic changes in the affected cells. 
Therefore, the process of cellular mutations whether caused by ex- 
posure to radiation, chemical agents, or viruses has come under 
close scrutiny. The need for this knowledge was evidenced by the 
consumers of basic research: the applied researchers. The fact 
that present knowledge of these processes was not equal to the task 
led to the research. ' • 

• 

In technological development^ needs are not identif ied^^^ much as 
are potentials. Because most advances in this area are designed 
to replace, supplement, or refine existing products and techniques, 
the need for a new product is demonstrated by the fact that an exist- 
ing product is outdated in terms of the state of the art. At this 
point, the problem becomes that of finding a new technology with 
the potential for doing a better job than existing technologies. 

In applied research, two streams of need identification are evident: 
one founded in the not-for-profit exploration of clinical problems 
anJ the other in the private industry development of new means of 
treatment— principally pharmaceuticals. The not-for-profit clinical 
segment of this category uses the results of epidemiology and morbid- 
ity and mortality statistics to identify those health problems v^ich 

» 
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.affect the most numbers and cause the most suffering. Priorities,^ 
are then established on the basis of this data. However, two other 
factors come into play. First, because virtually all of this form 
of biomedical research takes place ifn the large- hospital/medical 
school context, problems amenable to handling within these facilities 
receive a somewhat ^eater proportion of attention than their in- 
cidence rates might warrant. Second', as noted, diseases which 
have great emotional impact for the public (e.g.: those that cause 
death) also are given higher priority than a purely rational 
analysis might dictate. 

For-profit firms ate. faced with a considerably different set of 
probliems. First, the effect iye product life span in the health 
area is decreasing. This means that a new product must pay back 
its costs in a shorter period of time, or have a higher sucdess 
rate. It must alsp offset the costs of many other products that, 
I for one^reason or* another, fail to reach the market. This has put 
a premium on 'developing products which could penetrate the broad-/ 
est based consumer markets (e.g.: wide spectrum antibio&£cs) . In 
addition, the lengthy process of FDA approval pf new drugs almost ' 
* eliminates the. ability of smaller companies to compete efficiently. 
The tlairger companies need a broader market to justify their in- 
' vestment. Second, these firms must convince providers that the " 
new product" gives a, sufficieqtly greater therapeutic value than^ 
products presently in use to justify the risk" of trying it. Like 
the ♦technoldgical development category", for-profit' firms in the 
applied rii^earch category find themselves in* a "substitution" situ- 
ation. Coleman et al. 1966)* Need assessment , .therefore, comes 
, as much from surveying the providers, of health care .as it does 
from noting the characteristics of the ultimate "consumers. Again 
ef fectivesnss and piiio^it rather thaa> need .in the 'health arena- 
is of primary concern.' ' , ' 



XI, GENERATION/RESEARCH ' / , ^ 

Most of health R&D has been, and will continue to be,' based directly 
on the biological sciences* However, what is most impressiye about 
the present state of the R'/Dfiel system, at the research * stage, 
is the degree to which other physical science^ and the social sciences 
have begun to contribute to the field. Many of the newer cfeiical 
specialties such as nuclear medicine and radiology are based as 
much on physics and molecular chemistry as on biology and physiology. 
In addition to this, increased concentration on problems such as 
alcoholism and drug abuse have brought social Science results and 
methodology into the picture. And, as has been pointed out, the ^ 
technolog^ical development category of health R6J) is based almost 
entirely oh the technology transfer principle. 

In part these changes can be attributed to an expanded conceptuali- 
zation of what is meant by health. Not so many years ago, we spoke 
of a medical system rather than a health system; and medicine has 
always been a disease-oriented prpjEession (Coe 1970); Clearly, 
good medical care is an important component of any health system, 
but it is.not the only component. Today health is no longer equated 
with medicine as this definition frcnn the Constifeution of the World 
Health Organization demonstrates: "Haalth^is a state of total 
physical, mental, and social well-being, ^and not merely the absence 
of disease or infirmity " (Geneva 1958), This change in philosoph- 
ic orientation has opened the, doors for contributions from a number 
of the soQial sciences as well as from demography, environmental 
studies, and a host of others' idisciplines. 

Another important aspect of research is the impact that ney tech- 
nologies have had on the methodology of health R&D, On-line and off- 
line computer systems, fiber optics,, advances in bio-statistics, 
etc, * have opened new avenues of investigation by providing the medns 
to gather and analyze formerly inaccessible sources of data, /Also, 

r 
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Increased interest in "environmental" health problems has taken 
some research out of tKe laboratory and into the field. , 

■ ■ f 

In short, there has been a continued differentiation of fche field. 
On the one hand, investigators are exploring the physical and chem-* 
ical processes upon which biology and physiology ultimately rest. 
To do this, they utilize costly, scarce, high technology equipment 
such as the electron microscopi^ On the other hand, a renewed 
interest holistic aspect of humanity and health has lead 

,the health researcher out of the lab and into the field. Still a 
thftd group concentrates upon adopting existing technologies to 
health/medical problems. What Is not evident in the system at the 
present time, and is therefore an important policy issue is any 

conscibus attempt to integrate the findings of these various 

jf 

groups and establish priorities among them. 

•f 

As indicated, this work of research is to be found going on in 
a variety of institutional settings. These range from the federal 
institutes largely at NIH; the university medical schools, hospitals 
and ; departments of biology, bio-chemlstry etc.; in industry at 
drug companies, medical equipment and instrument manufacturers, 
supply con^anies; ' and in general hospitals. To this must be added 
the work of independent physicians, studies of human factors and 
biological phenomena, etc. in such agencies as National Aeronautic * 
and Space Administration, Department of Defense, and so on.' 
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XII. DEVELOPMENT 

The development phase of health R/D&I is of central importance to 
the system. In the research stage, experimental data has been 
gathered using principally animals in experiments. Full scale^e- 
velopment, however, i3 the stage at which the experimental results 
are inteif faced directly with the patient. In the development ^tage, 
the stakes are human life and welfare. In particular, the proba- 
bility of unanticipated side effects poses a great problem. Also, 
long term secondary effects must be considerei Ak^l Tt therefore comes 
as little surprise that this phase of the R/D&I system is the one 
that comes under the tightest regulation and control both by the 
profession itself and by the government. 

One of the areas of continuing conern in the research and develop- 
ments system is the question of the appropriate amount of testing 
of a new drog or device before it is approved for distribution. There 
are strong countervailing forces at work. Naturally the pharmaceut- 
Icaj^- industry is anxious to tnove'the product, to the marketplace as 
expeditiously as possible. In ac^dition, «the medical profession 
wants the most up-to-date treatments and drgus ayaiilable for their 
patients ..as soon as possible. 

The opposing forces are twofold. The public is generally concerned 

that unsafe drugs not be allowed on the market but their concern 

is general and may or may not be represented through consiimer 

groups. The highly scientific . or technical nature of the subject 

matter usually forces the issue back to the biological scientists 

at the Food and Drug Administration. Indeed the FDA has an uneaviable, 

thankl&ss job in the process. 

Wl>en Charles Edwards was con^issioner of the FDA he noted: 

It's a particularly difficult environment for the Food ^d ;^v: 
Drug Administration because, in a sense, we're in the middle « 



4 
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^ We are on the one hand, criticized for being "soft" 

on the industry .and on the other, called r6pressive, the 
enemy of free enterprise: on every major decision, ve are 
accused by some of acting too fast without sufficient evi- 
dence, and by others of acting too slowly and too timidly to 
prevent unnecessary harm, We're expected to deliver on the 
promises to complete safety made by others but when the time 
comes to take action we find ourselves standing alone. We 
Have had very little support and understanding from the medi- 

^ cal and scientific community. 

One would assume that, in addition to the pre-marl^ing reqearcA^ 
that the Food and Drug Administration performs significant post 
marketing surveillance of new drugs. This is not the case. Berger 
(1976) points out why: 

A major consideration is that of good "denominator" informa- 
tion. That is, in order to make observations on an exposed 
population (exposed, that- is, to a particular food preserva- 
tive igranqullizer, for example), there must b^ on hand 
some information that would set apart or identify the ex- 
posed population. In most leases, the identification and 
followup of a group of persons known to have been subject to 
specific exposures are exceedingly difficult. It ifi possi- 
ble with prescription therapeutic drugs— partly because 
the very act of prescribing is a kind of accounting system. 
Yet, even here, the problems of surveillance have appeared 
enormous and very little drug surveillance in any rigorous 
sense is traditionally carried out. The experience of the 
Food and Drug Administration in its attempt to carry out 
postmarketing surveillance of adverse drug reactions from / 
among drug-taking patients has been exceedingly discouraging 
—principally because of the very difficult task of identi- 
fying with reasonable cecrtainty those persons who are, in 
fact, taking particular drugs. ^ 

/■ . 

This is vital information. Without it, observations on 
human subjects cannot be compared with known, unexposed, 
or controlled groups and it becomes essentially impossible 
to interpret the observations. The National Academy of 
Sciences acknowledged this difficulty in theirs rev^tew of 
. adverse drug-reaction' reporting systems. In fact, the only 
really reliable information collected after marketing has 
begun on previously unsuspected adverse reactions from 
therapeutic drugs has been from carefully controlled in- 
tensively monitored, Ip-hospital studies. 



It should be noted, however, that the Food and Drug Administration 
• does have significant leverage in the prior ^approval process, The^ 
General Principles "Good JJanufacturing Practices" give the FDA 
the duty to insure the safe and efficacious production of drugs. 
The FDA can test a plant's control system, s||priliEation procedures 
and e^qn the room layout, 

• 

The main site fot development in the form of both applied research 
and tecll^aiSgical^velopment is the medical* school/teaching hospital. 
The developmental activities associated with applied research must 
be carried out in the clinical setting, and researchers at these 
institutions have a ready supply of subjects as well as the necess- 
ary back-up services. and facilities. Subjects usually, though not ^ 
always, come from the ranks of the welfare patients. Although theses 
individuals have the right to refuse such treatments i reasonable 
questions could be raised regarding whether or not they have suffic- 
ient knowledge to make rational decisions. 

Technological development also centers its pilot testing operations 
~ln the medical school/ teaching hospital context. These institutions 
are geared to innovation. In addition to this, they are relatively 
more familiar with high-technology, advanced st'ate^of-the equip- 
ment and favored *y pharmaceutical companies- because of their high 
prestige. Also, these institutions usually have the resources necess- 
ary^ to obtain the more esoteric products and the consumer base to % 
make use of them. i 



The Forward Plan for Health for FY1978-82 of the Department of H^lth 
^Education and Welfare speaks very cogently and honestly to the issue 
of our knowledge of generation and tjxe value of technology in'ijealth. 
In its broad analysis the report notes: 'The role gf^esearch in 
the generation of new knowledge continues to be a poo^J^ understood 



^ 400 - 



phenomenon,^p>rticularly the way in which new knowledge is aggre- 
gated and bringya about often subtle changes iu clinical prac- 
tice over time*" 



In speaking specifically of the role of technology in health care 
the report states: "iVlthough there .are existing technologies ' 
which, coupled with the appropriately trained manpower,' can have 
a salutary effect-On health care costs, it also now seems clear 
that widespread difisemination of Certain technologies at every 
level of the health^ care system may not always be an unmitigated 
good.» 

o 

In a recent speech Commissioner Kennedy of the Food and Drug Adminc. 
istration (1977) recognized the agency's role in the process of >) 
transferred technology. 

This legitimate role .involves a more "^ef fective exercise of 
what has become FDA's main f miction in our society: As a 
technology transfer regulation. 

During most of FQfc's-^iistence it acted primarily as a kind 
of detective, ferreting out transgressions, prosecuting the 
transgreSsors, and elimi^ting the fruitVlSf their iniquity 
from the marketplace. ^ ^ 

■1 

While we still stamp but quite "a lot of\sin, we increasingly 
have also* becpme a major control point in regulating the 
^I^ovement of new health ide^s and technology to the consumer* 

Commissioner Kennedy also responded in this speech to the issue of 
an American "drug lag" by citing a number of drugs and harmful agent 
that did not reach the American public (like Thalidomide). He did 
admit, however, that , ^ \ * 

...by and l^ge it does take longer here than in other advanc- 
ed nations- to approVe a new drug, although we've taken a num- 
ber of steps to spaed thi3 particular element of technology 
transfer.; These include i)rior agreement? about study design, 
sequential reviexi and approval of d^ta, >nd other steps aimed 
at eliminating unproductiye and inflexible procedures. We also 
are supporting legislation to remove all ^ Scientific data re- 
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lated to the safety and effectiveness of drugs from conceal- 
ment as trade secrets* 

Even with these changes, accomplished and potential, the pro- 
cess of demonstrating safety and effectiveness prior to market- 
ing may still move at a more deliberate pace than in certain 
other nations* This bothers me — just as it bothers some- physi- 
cians, and all drug sponsors. . . 

The answer is to look for ways to gain speed without loss of 
quality* And there are only two points at which to get it~ 
before marketing; or afterward. 

Except in rare cases where an 'imminent hazard' is deemed to 
exist, it is easier for FDA to do almost an'^hing than* to get 
a questionable drug off the market after it has been approved* 

Because this is so, our only responsible course is to take 
extra care in the approval process* To the degree that such 
care entails a time penalty, that penalty could be eliminated ^ 
by 'appropriate adjustments at the back end — at the point of 
removal. 

FDA has already taken the initiative in aluggesting a mechanism 
to accomplish this — an additional' phase fn the approval process, 
during which a new drug would be limited in distribution, con- 
trolled in application, and susceptible to rapid pullback if 
anything disturbing is learned. 

But we also ought to do much better about recognizing problems 
during the period of full clinical use. ^ Some critics, point- 
ing to the systems operating in Finland, Sweden, Great Britain 
and other nations, have cast us as a kind of underdeveloped 
nation in regard to drug experience, reporting , particularly 
adverse reaction experience* Although this conclusion is spme- 
what exaggerated, 'there is no doubt that the process in other 
nations is formalized, routine, and effective* The fact that 
these nations have such systems provides a key element , in their 
system of rapid premarket approval s 




XIII. PRODUCTION ^ , -i 

" • \ 

Production activities in the health industry can be subdivided into 

^1 » 
the manufacturing of supplies and equipment and the rendering of 

i 

direct?^ seryice to the consumer. In both cases, quality control is 
the primary issue of concern. Goveycnmental regulation has tradition- 
ally center||<l on the manufacturing-'Sutidivision through agencies such 
as the Food and Drug Administration^. However, /t^xis situation may 
noW^be changing. In recent years we, have seen the establishment of 
Pro^essibnaliStandar^s Review Organization to examine hospital prac- 
ticed^ Alsc^V organizations such as the American Hospital Associa- 
tion.;1iave tiraditionally established industry-wide standards for the 
equip^ipnt ut^^zed by their member institutions. 

It skdiild also btf: remembered that the health industry is one of the 
most ftibor ilijtensive in the country. Even in the high technology 
hospital selsl^ing, the majority of incurred costs are for manpower. 
Therefore, -tjRe System should, in theory ,x be relatively flexible in 
terms of iMoptin^ innovation (e.g. it is as easy, physically, to 
admiil^^ter ^ npw drug as an oldy. Hjpwever, this discounts the psycho- 
logical readit^ess of sys.tem members /to adopt innovation. A seridhs 
conaern £or %^ R&D system iar the fact that provider institu- 

ticrnft, in Ixfeht of increased government£kp. regulation and consumer 
activism, may well be becoming more coh^ervak^ve in their response 
td> i^^MaS^tion. 

4 
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Drug manufacturing plants are operated along much the same lines as 
most production shops that combine both mass-production and small 
batch lots. Requirements for quality control and hygiene are, of 
course, very stringent* Laboratory and various types of hospital 
equipment are nianufactured in characteristic electrical, electronic 
and machine plants. At this point it becomes difficult to draw sharp 
lines between for example, the electrical and health equipment indus- 
tries. 
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The pharmaceuticals Industry is one of the major segments of the 
industrial sector. It Isf^ international in scope, with major multi- 
national corporations based primarily in the U.S. and Europe. 
Companies tend to emphasizes, in varying degrees, "ethic^*' as 
opposed to the over-the-counter consumer drugs that can be purchased 
by the general public. Recently, there have been considerable 
pressures and constraints on drug manufacturers resul.ting from 

the acclivities of FDA. . ^ 

\ 

Hospitals, clinics etc. have also been thought of as a part of 
the health care delivery (or production) sub-system. Over the years 
these have grown enormously in complexity and in the sophistication 
and capital investment of the equipment and facilities utilized. 
This, has been one major . factor in pushing up costs. Another has 

been the increased costs of the labor and professional f sectors. 

/ ■ 

Altogether, the rising and by now very high cost of hospixal care 
has been a major social, econom±tr>and political issue. / 

■ ■ > ■ . " /' 



\ 
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XIV, MARKETING/DISTRIBUTION/BISpfiMINAT ion/diffusion 

The health industry ha9 experienced an unprecedented growth rate 
since World War If, and, at least for now, this remains high. What 
would occur should any of the national health insurance proposals be- 
fore Congress be passed, remains to be seen. Dramatic drops would 
seem unli^^ely.- Therefore most categories of health R&D are facing . 
a large prj^tftrty expanding market where new products are more likely 
to be difrused and absorbed than they would in a small or contract- 
ing market • 

However, two previously mentioned trends pose serious challenges to 
•the system. An increase in risk avoidance behavior on the part of 
health service providers cot^ld mean lox^r testing periods and the 
need for intensified sales' efforts, while the growing interest in 
environmental and preventive medicine may require firms to diversify 
their activities into unfamiliar areas. / 

The pharmaceutical industry is the mainstay of the applied research, 
for-profit category of Activity. As such, examining its marketing 
characteristics/problems should provide some insight into' overall 
system functioning. The drug market is extremely competitive and 
somewhat volatile. Leaders in the field have made innovation a way 
of life. They spend large amounts on market research and advertising 
principally for over the counter items. Also, an. impressive sales • 
effort is evident in the realm of prescription drugs. All pharma- 
ceutical firms employ large sales forces of "detail men.** The job 
of the detail man is to visit the individual practitioner, provide 
samples of new products, explain their use and advantages over exist- 
ing products, and convince the physician to undertake a trial usage 
of the product. The major problem facing the detail man, therefore, 
is to convince the physician that he/she should vj^ke the t(ime to 
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become Sufficiently acquainted with the new product. 

Another factor which Influences the marketing strategy In pharmaceu- 
ticals Is that the practitioner Is almost exclusively dependent upon ^ 
. the producer for Information concerning a new drug. The large 
amounts Invested in research have paid off haAdsom^ty^or the drug 
companies, and the rapidly accumulating body of knowledge about drugs 
and their effects has led to an liicre|^sed tempo of new discoveries 
(Coe 1970). Each new prt^duct xrfiich comes, to market is complex and 
relatively individualistic , requiring considerably sophistication 
and expertise for effective use. In addition to tl^s, the overall 
use rate of drugs , both in number and volume, has increased sharply; 
in part this has been dOe to an Increased emphasis on the treatment 
of chronic diseases which usually require extensive chemotherapy to 
stem the advance of the disease. These factors make it extremely 
difficult, if not impossible, for the physician to stay truly 
current in the field. * ^ 

As a result, physlcl'ans harve become more and more dependent upon the 
detail^ men and the suppliers' abstracts, etc., as a source of infor- 
mation about advances in the field. One study indicates that the 
detail man is by far the most Important Information source about 
new drugs utilized by the physician. However; the decision to adopt y 
or not is strongly influencied by the physician's close^colleagues. \ 
(Coleman et al. 1966). The situation is further . complicated by 
the practice of using proprietary "brand" names for drugs rather 
than their longer generic or scientific names. With the |)hyslcian's 
performance coming under closer critical scrutln^ by both the govern- 
ment and the patient, the practitioner is becoming more wary of"* 
new products and the information he/;3he receives about them. This 
may dictate a con^idj^rable change in the .marketing strategy of the field. 

Marketing 4k^w^ to physicians represents one discrete segment of 
the overalIlr^eal<^'inarket . Of equal concern should be the strategic 
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and characteristics of the health market with respect to the diffu- 
sion of Innovative facilities and equipment. The adoptors of such 
Innovations are usually hospitals, with respect to the adoption 
behavior of hospitals. .Russell and Burke (1975) were able to document 
. the rate of adoption of several dlfiEerent Innovative facilities and 
equipment by hospitals of various slzes^and types of control (public 
vs. private). Their conclusions Indicated that size was a far more 
determining characteristic In adoption in that large hospitals were 
'almost exclusively the Innovators and ear^ adoptors.' From the 
larger hospitals, the Innovations diffused to the smaller hospitals 
over varying perlods^of time. 

While Interesting, If not surprising, such conclusions do not yet 
describe the marketing characteristics of the health services field. 
Of more importance- would be Information describing the adoption- 
decision processes used by such institutions. The same authors 
(Russell and .Burke), however, concluded that ll^le Is known about ' 
the adoption motives," or processes, of hospitals. Such information 
would be critical to our understanding of the Health R/d&i system If 
we accept the feasible premise that the system has somewhat distinct 
market ckaracCerlstlcs# as might be indicated by our earlier comments 
regarding the general lack of sensitivity of the health sector to 
economic fluctuations. 

If the health innovation adopters are not sensitive to traditional 
market incentives, then it should be determined exactly what Incent- 
ives do sensitize them. Again, Russell and Burke suggest some possi- 
bly important factors, including: local, environmental characteristics, 
accreditation criteria, organizational ability to procure avallaWe 
funds, federal funding "guidelines", and others.. Without suggesting 
too much comparison. It can be noted that some of these characteristics 
were observed to be Important adoption-behavior determinants' in the 
Radnor (1975) study of the Law Enforcement R/D&I system. 
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For Qur discussion horo, it can only bo concluded that the market 
characteristics for the diftiilaioa of innovative equipment and 
facilities for hospitals arc not understood oufficicntly well, 
^her than to postulate chat the traditional market model is inappro 
priato. ' / 



/ 



• XV. ACQUISITION " . . ' . 

■ ■ ' s. 

. - 

The Characteristics^ "of the acquisition process. are most relevent to 
the technological development category of health R&D activity. - Most 
sales for these products are confientrated in the hospital sector; 
and, as such, those factors .impacting the' willingiiess or ability of 
these institutions to acquire new equipment are of central impor- 
tance. I . * 

There are four factors which contribute to the acquisition decision: 
need, present services structure, status, and Availability of funds. 
Need assessment is based on the characteristics of the population . 
■ served by th%, hospital. Thus many urban centers with their large * 
populations and higher birth rates than the country as a ^ole' make 
great, demands on pediatric facilities such as nurseries for pre- 
mature infants. Although a hospital may have all the facilities it 
" really needs, these facilities may be outdated. Therefore, the 
decision to acquire-replacement units will be based on the state of 
its present ser^ces structure. Peer pressure or status play the 
major role in the acquisition of hew, "cutting edge" technologies. 
IJost of these products are relatively low capacity knd capital inten- 
sive; therefore, purchase is hard to justify in terms of consumer 
need. Second, financial donors are more ^willing to contribute to an 
institution that is a "leader" in the field. 

The availability of funds has, in the past, had a greater impact on 
the timing of acquisition than on the decision to acquire. Feder^lT 
monies were wide^ly available to upgrade present facilities, add i/ew 
ones, and incre^\he ^pacity of the hospital. However, this situ- 
ation changed significantly when in 1966 Public Law 87-749*, Compre- 
hensive Heak:h Planning (CHP) Act, was passed. This legislation 
created a. series of state-wide health planning groups ("A Agencies") 



*This ha^ more recent ly been modified in a new law PL93-601. 
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■atid subsidiary groups ("B Agencies"^ . ^ese groups had the power to 
control the flow of federal funds into the geographic area for \«hich 
.they are responsible. Composed of both consumer and provider repre-" 
sentaCives, the CHP agencies we4e charged with the task of matching 
Consumer needs with a-\^ilable resources, and recommending what addi- 
tional resources might be necessaryy Therefore, although funding for 
these types of projects increased, the availability of the fund^ came 
under tighter control.. 



With respect to the acciuisitxon of innovative hospital facilities, 
(e.g., diagnostic radidlogy, and intensive care units), Russell and 
Burke (1975) confirmed that lar^ie hospitals generally are the innova- 
tors and early adoptorsL with t^xe innovations diffusing to, smaller 
hospitals, as needs and funds become available, - 

. Perhaps of more significance to oui consideration of the'^ acquisition 
process is the conclusion that little is known about the adoption- 
decision process of hospitals. Moxe information is needed to answer 
questions such, as who is involved in the acquisition decisions, how 
much technical vs. admin Lstrative input is represented in the decision, 

.what is the impact of bu<lgeting and purcha^sing' procedures, where does 
the interest in the inno^ration originate in the hospital, what are 
the characteristics of irlnovative hospitals, etc. Schermerhorn '(1975) 
has raised the issue of cooperation between Hospitals as a factor in- 
fluencing the likelihood bf their acquiring specific facilltes^ by* 

^king it feasible for smiller insti,tutions to a;cquire such frequently 
expensive but infrequentlj^ utilized equipment. 
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XVI> IMPLEMENTATION/UTILIZATION 

Since one of the prime' driving forces for adoption of an innovation 
is status, ihe very existence of a new product or technique creates 
a demand for it. As such, the level of direct, formal coo/dination 
between the health R/D&I system and th@ health services system 
tends to be low. To be sure, the guidelines attd standards set by 
government regulatory agencies and the ^health field's national repte- 
^ sentative organizations (AHA, AMA, etc.) Provide some formalized 
feedback. But for the most part, this feedback acts, as a quality 
control measure rather than as input into\.the p^lanning process. ^ 
Therefore, that Integrat'ion which does take place between *the R&D 
system and the user dej^ends more on informal information channels 
than on' formal ties. ♦ . 

There are a number of' individualV professignal and structural issues 
that impact Implementation. The professional status of the* physician 
is of central Importanc^a^ Besides' generatiing a profession-based form of 
chauvanl^^i^hat limits Inputs from tibn-medical sourcesy the^ssue of 
status creates related systems level implementation difficulties. \ 
The medical -staff at' hospitals maintain a high degree of autonomy 
among specialities and from the a!dmlnistrative arm which constrains 
coherent overaM systems level Innovation programming tied to resource 
availability and planning. Relatedly, physici^^ns may act to acquire 
expensive and sophisticated equipment not critical for diagnosis or 
treatment, therapy artificially increasing the tate of utilization 
(Rubenstein and Gelsler 1975). Malenbaum (1971) has commented that 
there may not be a close relation 'between the acquisition ojE new 
sophisticated equipment and the quality of health care. The Individ.- 
txal productivity of the physic iai? as well as the physical risk aver- 
sion, given the often critical nature of the application for life, 
may further act to constrain potential implementation. This may be 
especially the case where significant retraining may be required to 
properly utilize new technologies. 
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Two distinct contents for implementation/utilization can be delineated 
wltUln the services system: the large » urban hospital (with or with- 
out a medical school) and the sinall^ rural hospital. (The adjective 
**small" is defined as 100 beds or 'less.) It should be remembered 
that the majority of hospitals in this country fal.l into the latter 
category (AHA 1974). The characteristics of the^ institutions, 
therefore 9 have an important impact' on the absolute level of accept- 

ance exh4>bited by the service system towards innovation. 

'•• • ■ . ^ « p 

^ Virtually without exception. Innovations ^re adopted more rciadily and 
sooner by the urban hospital than by its rural counterpart. There' 

- are three fafct or s \^ich account, for this difference: the availability 
of information about the Innovation , the market/resource structure 
facing the institution, and the psychological preparedness of decision 
makers to support Innovation. 

Availability of information Is airectly related to the/ communication 
pattrerns evidenced by the field; and, because, formal integration is 
relatively low, those organizations that have the highest degree of 
informal interaction with, the R&D system are the ones with the most 
information. The medical school/teaching hospital is the ultimate 
example of this with both R&D activities and implementation/utilization 
occur Ing in the same organization. Other large, urban ^hospitals may 
also house research — and even if not, they are certaijLnly JEamiliar- 
with hospitals that do. Further, city-wide hospital associations 

. of ten provide a clearing house for a "variety of information dealing 

^wlth both administration and operations. 

By comparison, rural hospitals, in -relative Isolation, are out of the 
mainstream of research a«i rarely come into direct contact with organi- 
. zations in the stream. They must depend on state-wide hospital and 
the A.H.A. to provide them with information which may or may not be 



suited to their particular needs/interests. Furthermore, organiza- 
-tions within the health R/D&I system have not invested much marketing 
,effort on these organizations, j)rpbably because they perceive little 
or no potential in the rural hospital market. As a result, the 
rural hospital is usually the last to know about an innovation; aiid 

even then it will receive only ^agmeatary information. 

/ , . • . 

■/ . - 

•Further,- the psychol.<igical preparedness of decision makers to support 
innovation is an extremely important factor. The administrators of 
urban hospitals teiid to be highly educated, mobile, and cosmopolitan - 
in outlook; Ofte^','they have received degrees from special graduate 
programs in hospital administration in first rank schools. The 
administrator of /the rural hospital, by comparison, h^ a much more 
varied and less ^cademic background. A recent survey or rilral hospi- 
tals in Southern' Illinois (Pipal 1975) found examples of administra- 
tors who were also registered nurses. X-ray technicians , and labora- 
tory technicians (and in one case, all three'). Less familiar with 
advanced technologies and the rble of R&D in the overall health system, 
they tend /to be more skeptical of those innovations that do come to 
their attention. 

In addition to this, rural hospital administrators tend to remain with 
the same organization for longer pei^iods of time than do administrators 
of urban- hospitals. This can lead jto significant emotional investment ii 
the organization as it exists. This, in time, usually leads to in- ' 
creased resistance to innovation* (Gardener 1968). 
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XVII. SUPPORT SERVICES 

The support prerequisite for bio-medical research varies with the area 
under investigation and the catagory of R&D activity engaged in basic 
research, applied research, technological development. In almost all 
instances, basic support services materials are available and 
hot terribly costly.; For example, in bacteriology, the basic re- 
quirements for .research are lab space, an dncubator (for cultures), 
cold storage areas to maintain perishable supplies, an autoclave 
for sterilizing instruments and containers, and basic chemical stocks. 
Also such standard equipment as microscopes arid balances are required. 
<r In those few areas where high technology has become extremely import- 
J^M^i- ^V-^ (elg. cellular studies using the electron microscope), it is 
V ' ^^^^r '^^^ uncommon for the research organization to employ its own main- 



tfenancj^ staff . In general, external §uppQrt syate3qi§.4)lay a very 
small direct role in most health research. ^ 



Of considerably greater importance are the interdependent and support- 
ing roles that components of the health R/D&I system play for each 
other. Basic research supplies the specific information %iecessary 
for applied research; the technological development catagory produces 
the specialized instrumentation necessary for basic research; etc. 
Even within a given catagory, different research centers will often 
perform support functions for one another. For example, in virology 
a given cell line will be maintained at three or four different 
laboratories. Therefore, shobld some accident occur which destroys 
the cultures of one lab, the others can provide replacements with 
no loss of continuity. \ 

In addition such organizations as the American Medical Association 
and the American Hospital Association play important political and 
economic rolesy^n supporting the health care^system. The American 



EKLC 



Research Association is directly involved as a participant in the 
R/D6cl system. Blue Cross, Blue^^Shield and* Various insurance com- 
panies play an important financial fole in tke.R/D&I system that 
makes feasible the utilization of .expensive innpyat ions by spreading 
the cost^ over a large base. ' 
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XVIII. EVALUATION RESEARCH 

* 

The President and the Congress have taken a more active interest in 
the evaluation of the state of bipmedical research in the past-sev- 
eral years. The President's Biomedical Researph Panel (1976) was 
charged with the mandate to review and assess the conduct, support, 
policies and management of biomedical and behavioral research as 
conducted and supported through the programs of the- NIH and Alcohol 
Drug Abuse and Mental Health Admins tratJ.on, In addition, the Congress 
mandated National Commissions on Diabetes and Arthritis to study these 
diseases. These commissions have been helpful in-focusing public' 
attentidn on the diseases and useful in coordinating the attention 
of the research community on the problems. They have also created 
serious budgetary imbalances within and among the institutes as 
there have been no additibnal funds appropriated for research in 
diseases other than the favored diabetes and (to a lesser extent) 
arthritis'. ' 

^Different facets of the evaluation process have been discussed 
throughout the body^^ this examination of the health R/D&I system. 
The most notable feature of the process is that the criteria for 
evaluation have tended to center almost exclusively on effectiveness^ 
With little attention paid to the cost/efficiency of treatment. This 
was explained as being due to (1) the philosoph;.cal basis of Westejwi 
Medicine which places a premium on individual life, and (2) the 
fact that third party payors have, until recently, shown little in- 
S'erest in cost control. . 

-Atiother aspe^ct of the evaluation process which should be considered 
is its "phased" nature. At each step in the research, development, 
adoption, utilization sequence, different and independent evaluations 
of an innovation take place^ Control/evaluatiol|^ of the research 
phase lies primarily in the hands of the Researchers themselves. 
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Standards for approfrlateness of research topic apd methodology are 
set by the field. - J \ 

During the development stage, the Federal regulatory agencies and 
the national health representative groups evaluate products in 

terms of minimally acceptable standars^s of performance. In general 

' ■ • / • ' 

however, these standards pose few operational/ problems for the system. 

% v / 

Host products which survive the field? sv own rigorous testing require 

% : / 

little or no modification to meet government specifications. 

' ■ i i ■/' ■ ' ' ' 

A more critical test for the innovati|>n^ occurs during the early adop- 
tion phase. At this time, health care providers perform their own, 
informal "test piloting" of value over existing products, ease of 
use, and re-training/re-education necessary for large scale imple- 
mentation. Because many of these evalti^^lbns must rbe based on sub- 
jective information, the R/D&l systemlthil little control of the 
process. 



mi 
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During full scale utilization, th|i.rjLnhovation is not evaluated so 
much as is the practitioners' use|bf the product. Professipnal stan- 
dards review organizations (PSROs|f and utilization review boards (URBs) 

are more Interested in' the proper |usff of all available facilities, whether 

'4 ■ ■ ■ * 
recent innovations or not. However, if the R&D system has not provided 

adequate information to users concerning a new product, such organi- 

zations as PSROs and URBs are likej.y t£o pick it up. This will re- 

fleet negatively on the particular organization introducing the 

innovation, dnd could cause that organization to lose credibility in 

the eyes of the intenr^diate consumer. 
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XIX. RESEARCH ON R/D&I ' 

To date, there has been little or .no empirical research done on the 
health R/D&I sy^em of this country. VHille many orgaiilzatlons 
co'llect statistical Information on various components of the field, 
^verall totals are difficult to obtain. In addition to this, anal- 
ysis of these partial statistics ^s often Implicit and subjective 
idlth little consideration given to the comparability of methodologies. 
In short, our knowledge of the health R/D&I system Is based more on 
opinion than It Is, on fact. 



t 
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THE R/D&I 'CONTEXT IN THE CRIMINAL JUSTICE SECTOR 
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INTRODUCTION . / 

■, • * ■ • • 

This report vill utilize the CISST contextual analysis framework to 

describe the R/D&I system of the criminal justice sector. The National 

Institute of Law Enforcement and Criminal Justice (NILECJ) is the key 

agency in the R/D&I system in this s6||^or and will receive much 

attention ±^ the following analysis, as will its parent agency, the 

' (>'•, ■ * • . 

Law Enforliement Assistance Administration (L£AA); yWhile NldXJJ*t-and._^, 

V . 
LEAA will be discussed most often in their current organizational 

forms, it should be'' recognized that, the Attorney General has just* 

recommended to the President a major reorganization of the agency. 

The reorganization, if accepted, would combine reseai||ph in a criminal 

justice function (such as corrections) with action programming for that 

function. This^ reorganization would have the effect of f acf'ilitating 

the flow of the R/D&I within sector functions (police, courts, or 

corrections), but the eff^t of a more system-wide approach to criminal 

justice is somewhat problerJa tie* Other proposed chants would include 

financial incentives for sector institutions which adop^v?;ea^rch-proven 

programs which should encourage the utilization of innovations. The 

following analysis will start i^ith a description of thef criminal 
' . ' ; . ' ' • . . ....... 

justice sector* Then, the nineteen points of the contextual analysis 

framework iwill be utilized to analyze the R/D&I system of this sector. 
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THE CRIMINAL JUSTICE SECTOR 

The sector of interest in this paper involves criminal juatice — a 

field of interrelated activities/institutions (identifiable as such 

for practical purposes) which is Responsible for maintaining 

law an5 order in society. The boundaries will be drawn at one end 

by excluding the* makers .of the laws which are being enforced 

(legislators) and at the other end, the clients served by the system 

(criminals, victims and the general public)* The functions of the 

criminal justice system include: 

( - 

. :■ : V " .. ^ 

Prevention functions (e.g.: patrolling, raising community ^ 
awareness) ^ 

Adjudication functions (e.g.: prosecution, defense, inter- 
preting the law, judging guilt or innocence) 

Disposition functions (e.g.; * jails and prisons , community 
residential ^programs, probation) 

Rehabilitation functions (e.g.: counselling, assistance in 
job finding, vocational and educational programs) 

Reentry functions (e.g.: parole) ^ 
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I. ENVIRON>ffi:NT 

Tl;^ crininal justice system (like any system) existis within, affects, 
and is ^ffecte^ by its environment. The following analysis will 



d±dt^3 the interaction of the criminal justice R/D&I system with , 
itS*etivironment including: political factors, ethical consider- 
ations, economic factors, social cultural norms, related disciplines 
and institutions affected by criminal justice R/D&I. 

^1. Political Factors ) \ 

• •■• ■ ^ ■ \ 

\ 

Ci^^nal justice agencies exist and are affected by, all levels of 
goilP^nment, Fqr example, in enforcement there are: federal agencies \ 
such as FBI, DEA, and the Treasury; state agencies such as a highway 
patrol or a state bureau of investigation; county agencies such as 
sheriff's police; city agencies puch as local police depai;tments* 
(city police). The heads of the agencies in the criminal justice- 
sVstem are either appointed by elected officials or must- stand for 
d^ection themselves. This situation subjects these agencies to 
political pressure. The public's fear of crime accentuates this 
pressure. ^ ' • * 

Two effects of the political environment are (1) resistance to in- 
novations which cross jurisdictional lines, and (2) pressure on 
the R/D&I system to be accountable for the reduction of crime. 

Regarding resistance to innovations which cross jurisdictional lines, 
an example may be a diversion 'program (treatment rather than trial) 
Which requires the cooperation of the. police and the State's Attorney. 
It may never get off the ground in a given instance when,»for example, 
the participants are from different political parties and want to 



^here are also rib^-governmental agencies such as private security 
firf!f&; security departments of large firms or of a university; etc. 
However, we shall in this analysis focus on criminal justice as a 
function of government. ^ / 
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set up independent programs: Judges often ^^"sist Involvete^ 'i. 
cross- jurisdictional prajacts due to-xpossible* viC|^i^lj^^^^ ' 
separation of powers. ^ ^ ■ r ^'•'^ - ^' ^ - / " . *. * . 
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2. Ethical Consideratio tfe ' 1 ' ' / ' 

~. ~~ ~~ '7' ^^.^f- ■■'.'-"^'■'^ 

Since the criminal justice system operates on human beings in a'context 
where the issues of laws and rights are predominent, eth^.cai con- 
siderations are a significant part of the environment. Examples of 
such issues are the current national preoccupation with the rights 
of the individual, protection of privacy, freedom of information, 
informed consent of human subjects in research projects, disclosure 
^ and. publication of research results, etc. Additionally, the social 
and iRnomic costs of crime, the fear of crime' (particularly in 
urban^ateas) and the concern about the degree of, justice in the 
criminal justice system — all impact the R/D&I environment in criiainal 
justice. The uncertainty (about how to handle criminal justice problems 
and the s^ial unrest of the 1960s) has been a primary reason for the 
substantial increase in criminal justice R/D&I during the 1970s; 

The above often result in pressure on the. R/D&I system to produce 
Immediate results in reducing crime ~ pressures that are unrealistic 
in the light of the lead time involved in this activity, if it is to 
be well done. This pressure has resulted in LEAA funding, programs 
which have not been adequately tested, and often neglecting the col- 
lection of process information which could be useful in an evaluation 
designed to^determine how to improve the program;. The public's 
fear of crime has an even more direct effect on the R/D&I system by 
^ limiting the type of innpvation which may be attempted. ^Heated pro- I 
tests against community 'corrections programs from nearby neighbors 
and store owners result in tjhe kind of political >pessure ,which can 
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close down these innovative programs. Fear of negative public 
reaction to even a low perjcentage of failures oftefi results in the 
assignnent of only low riski^of fenders to such programs as work 
release, thus virtually invalidating any evaluation. Bail programs 
come under pressure when persona waiting trial commit farther crimes. 

These problems are exacerbated when what are sometimes extreme . 
judgment errors are mad^ e.g.: recommending release of certain 
major offenders on their own recognizance. In addition, the ever 
present! tension between individual freedom and the need for social 
control leads to Conflicting pressures affecting innovation* in the 
sector (e.g.: access to arrest data). 

Sources of pressures affecting the criminal justice R/D&I system in- 
clude congress, universities, pressure groups and* law enforcement 
professional associations. Some members of Congress seem to )bfe against 
criminal justice research of any type. On the other hand, uri^-versities 
and discipline associations such as the American Psychological Assoc- 
iation press for increased commitment to research and improved pr^^ect 
selection and design. ^ \^ 

The consequences of the abpve pressures have included the creation of 
the NILECJ (National Institute of Law Enforcement and Criminal Justice) 
in the enabling legislation for LEAA,(Law Enfocement Assistance Ad-^ 
ministration)*. This has resulted in the funding of some research and 
the use of funds for assistance to action programs. 

3. Economic Factors ' 



Funding agencies such as NILECJ greatly influence the types of projects 
and the individual investigators that are supported. Conscious policie 
can create msjor shifts in the overall nature of R/D&I. Political 
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priorities of elected officials in turn influence the policies of 
funding agencies * The shift from the funding of routine hardware 
to that of innovative programs in criminal justice (including the 
development of innovative hardware) is a prime ex^ple of this process. 
There is currently a more supportive economic environment for criminal 
justice R/D&I. Federal support has increased from .17% ^n 1969 to ,5% 
in 1974. Suppoi-t from the priva.te sector has also increased (private 
industry and more notably such foundations as Ford, Guggenheim, and 
Russell Sage) . • . , 

» .. ^, . . ■ ^- . ■ ^ ■. ^ 

As economic support has increased, the technological environment has 
also advanced, making the shortcomings of the R/D&I sector l^ss 
acceptable ^and increasing expectations regarding their ability to 
produce usable innovations (TFCJR&D* ^976). 

' 4. ^^ociai/Cultural Norms ' ^ 

Other sodial/cultural norms and values of spciety also have an impact 
on what research is accepted in the criminal justice sector. The use 
of certain drugs (tranquilizers) and certain treatments (behavior 
modification) have been criticized. Some apprehension and detection 
techniques (such as wire-tapping) tend not to be acceptable in our 
culture. Certain subcultures have differing views as to what is 
considered criminal and what are appropriate techniques to use^ in 
enforcing the law. These norms and values provide constraints as .to 
what research can be undertaken. They also impact tie diffusion 
process, since some new techniques are more acceptable in one subculture 
than in another. 



S^ociehfy's general posture towards criminal justice R/D&\E activities 
(as opposed to law enforcement per se) is probably neutral. Exceptions 
which might raise opposition are innovations in some techniques which 

# • • • - ■ 
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*TFCJRiiD: Task Force in Criminal Justice Research and Development 1976. 



may reduce individual liberty (such as wire-tapping) or increase their 
chances of becoming a victim (such as a .cpniinunity corrections program 
in the neigh'l^orhood) . 

5. Related Disciplines 



The knowledge base that is potentially applicable to the criminal justic 
sector is vast and fairly^well developed. Much of the research based 
knowledge in other sectors is underutilized by criminal justice agencies 
Information processing systems technology is just recently' being ex- 
ploited by lOpal law enforcement agencies. ^ Organizational research im- 
plication's (eig» • matrix management) are generally not applied by 
criminal justice orgjpizations , Systems analysis and operations re- 
search have been finSng applications in law enforcement such as in 
allocation of patrol resources, patrol 'car scheduling, etc. The basic 
disciplines from which the criminal justice R/D&I system may draw i1:s 
knowledge include: chemistry, biology,- sonics, psychology, ^sociology, 
ballistics, communication, information sciences and organization be- 
havior. There are many mechanisms for the transfer of knowledge, from 
journals (although these tend not to be very sophisticated" in content) 
to training or calling in outside experts. Barriers to transfer of 
technology to users includei^^ack of sophistication on ^^^^^^ 
the user, lack of funds to implement the innovatioi^, ^^^^NIHB^^^^^^^ 
of the innd^tioa, and lack of desite for cl^nge. These 4)ar^iift:'s\^ 
knowledge utilTMtion serve- to^ discourage the effort put into the 
.knowledge production stage (especially by business organizations) - 
since there is a limited market for innovations. 




4 ■ ^ 

feme 



-ff. Institutions Af f eoled by Criminal^ Justice R/D&I 

Part of the environment for R/D&I consists, of the potential users. of 
innovations.'* In the criminal justice sector, the potential users go 
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beyond criininal justice institutions to also .include schools, social 
welfare agencies, health agencies, mental health agencies, and the 
R/D&I systems of other septors. One aspect of the criminal justice 
R/D&I system which has a\trong and direct interaction with users 
from the environment is prevention. Most of the innovations in 
prevention have direct application in actions to be taken by mentfjers 
of the environment such as schools, property owners, etc. Thus 
liinovations in thi<s area must consider what proposed actions by 
the members of the environment vd.ll be acceptable to those parties. 



As the above indicates, the interaction between the criminal justice 
R/D&I system and its environment is an important consideraton in 
the planning of criminal justice system innovations. 



2(i 
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IT, HISTORICAL DEVELOPMENT ; • ■ ( 

The criminal justice R/D&I system has been functioning since crime 
began. Most of the early innovations were in the area of ajudication 
(trial by fire) and punishment ,(an eye for an eye, stocks, prisons) - 
The major sector of influence was religian. The next innovations 
came from within the criminal justice sector (often heavily in- 
fluenced by other sectors such as mental health) as practitioners 
sought to improve their operations (e^g.rwork release ). 

Prior to the mid-1960s basic research specifically for the criminal 
justice sector was virtually non-existent. Applied research also was 
very rare. Most innovations consistjed of applications of the results . 
o*^ the R/D&I systems in other sector^and disciplines. Dissemination f 
of ^ innovations was limited by inadequate mechanisms and a lack of 
resources. What innovation^ did occur were mainly in the area of 
enforcement and were developed by federal agencies, principally the 
Federal Bureau of Invest igat;ion. «: 

1- NILECJ ' 

The major ^vent marking the begiiining of the serious development of the 
criminal justice R/D&I system was the creation in 1968 of NILECJ 
(Natioaal Institute of Law Enforcement arid Criminal Justice) and its 
parent agency LEAA (Law Enforcement Assistance Administration) (Rettig 1976) 
NILECJ was created with a research' mission and a dissemination 
role. LEAA discretionary funds provided some encouragement ' to local 
criminal justice agencies to be able to acquire the innovations of the 
R/D&I system. 

Being hoiised within (and subject to the leadership of) LEAA, NILECJ 
has beer, buffeted over, the past decade by LEAA's unsure (the troika 
fcrx cf management) and changing leadership (about one administrator 
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or acting administrator per year since inception). NILECJ itself 
has had several directors in the brief period it has been in 
existence. Henry Ruth was the fi*st confirmed director of NILECJ 
in 1969. He s^t up the Institute in five centers: prevention and 
rehabilitation, law enforcement, criminal law, the fellowship «. 
program and a dissemination and technical assistance group. Director 
Ruth apparently spent most of his time trying to justify the role of 
research to Congress and LEAA leadership. This phase can be charac- 
terized as trying to obtain a foothold for research In the LEAA. The 
next phase began with the directorship of Martin Danziger in 1971.,^ This 
administration accepted the demand that their performance \^as to be 
measured by the reduction of crime. The implication of this decision 
was that research funds were diverted into direct support of an action 
program: Impact Citia^ The focus shifted to crime-specif ic planning. 
This resulted in a reorganization of the Institute into an action 
.oriented structure. NILECJ fpnded large scale grants. This strategy^ 
facilitated increased political^ pressure on the awarding of\hese large 
supas and thus resulted in violation of evaluation design standards 
which in turn reduced the extent to which such programs could add ta . « 
the knowledge base (NAS 1977) . ' 

Gerald Caplan was the next director of NILECJ in 1973 and he de- 
e^phasized crime reduction as the goal. He committed the Institute 
rather to a long range objective of contributing to overall reduction 
in crime. Caplan engaged in system building activities by encourr 
aging the participation of a research community interested in more^ 
basic research questions. He moved to^rds many smaller grants and 
tried' to forge links with the academic/research community. -These 
actions seemed directed towards a new strategy, one of understanding 

the social and behavioral phenomena that underlie crime. >The de- 

....■5- 

centralizat ipn and eclecticism of this new approach as it was im- 
plemented seemed to lack cohesion and a researclj agenda. The goals 
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of the sub-units (programs, evaluation and technology transfer) 

seemed to be prevailing over any total Institute purpose 4NAS 1977). 

I 

2> Recent laitiative 

The recer.r initiative under the Carter Administation (1977) includes 
proposals by Attorney General Bell which should strengthen the R/D&I 
system while perhaps potentially weal^|^ng one aspect: basic research. 
The Attoimey General's proposal includes the integration of Research & 
Development activities with discretionary^ action programming. This 
integration would be arounJ^an ideal formalized process which virtually 
institutionalizes the R/D&I system concept (policy analysis, problem 
definition,' selection of response strategies, testing, demonstration, 
program design, and marketing with evaluation built into many steps). 
In addition the proposal" includes the provision of financial incentives 
to local criziiaal justice agencies who adopt innovations which have 
been produced by the R/D&I system. From another perspective, tMs 
marriage of research and action could be viewed as a reductiqn in 
emphasis on basic research. One of the prior criticisms of LEAA was 
that the administration exerted too much influence over the Institute. 
Under the new arrangement, research would be linked even more closely 
to action programing. Some specific provision *for the pursuit of 
basic research (v^^iich may have no immediate action payoff) may be 
needed. This is the type of activity whicb|j|jtequires governmental 
support, due to the high risk and limited l^M^ly payoff. 

The direction of -criminal justice R/d1SiI has been largely determined by 
social nee^s. Perhaps for this reason that there has been little . 
agreement on the primary role of R/D&I in criminal justice — whether 
R/D&I should focus primarily on problem solviag or on the development 
of knovledge- Essentially this again raises the question of control — 
should R/DLI be controlled by research- or the operating agencies 
(TJCJRiiD. 19 76), 
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* 3, Other Developments 

During ali^ these years, expansion of knowledge with respect to cr^mlpal 
- justice has continued in other places. The FBI has had a long and 
growing investment in methods of investigation, etc., as have other 
law enforcement* branches of federal government (Treasury, Secret. 
Service, the military, etc.). Much of what has come into civilian law 
|P|. enforcement has been derivative (especially in the equipment area; 

e.g.: night vision devices) from the military. Also, the R&D activities 
of the electronics and communications and other industries have, in the 
course of thei^r own recent development patterns, contributed to the 
development of criminal justice R/D&I. 




si^d^, while beset with problems and buf fetted by change, the 
criminal justice R/D&I system seems to have gone through its birth 
pangs and vould now ^seem to be in some type of sorting out or transi- 
tional phase. However, in spite of the§e efforts and despite the 
current apparent centralization going on, it appears that it will be a 
long and difficult task to develop a cohesive criminal justice R/D&I 
system. Perhaps its high visibility and the public control through . 
elected representativies will keep, at tenti^bn focused on immediate 
rather than longer term ventures. For the same reasons, the emphasis 
of criminal justice R/D&I may continue to shift (e.g.: in only ten 
years the field of corrections has sWung from punitive to rehabilitative 
and back to punitive — each switch representing public pressure 
from some major constituency). , ' " 
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I'll. INSTITUTIONAL BASE 



%/pS»l systems are usually "composted of a variety of instsitutions Iposely . 
linked into network- Various levels of goviernment;, industry', academia,^ 
privat^ research orgarvizatlons and foundations are included in this 
networH^^ -The R/I>^f s^^stem includes institutions whose pirii^ry function ' 
is research and/or development and institutions which are mission 
•oriented -(have an operating or user primary orientation) but which i 
serve some R/b&I,role- ■ . ' . , ^ . • ^ 

^ Examples of. In&titutipns whosTe primary functit>ns are i^ the realm of ' 

drimiAal Justice R/D&I are the Center/ for Studies* of 'Crime ^nd De-' 
• linquency <CSDC, part'of the. National Institution of Mental Health of 
'*^he Department of Health* 'Education and Welfare) and the National 

^ Institute etf Law ISnforcement' and Criminal Justice (of the Law Enforce-^ • 

■ ■ ' ' . ■ ■ ■ . ' ■ » ' ■ ' 

.ment Assistance Administration, in the Department of Justice). These 
two have been^||pscribed as the Vpost •comprehensive" in this role . • . ^ 
(l^ettig, ' 1976)* There are alst^^uch private foundations and institu-' 
tions as ^he V^ra Institute, Rand and various^ universities. Examples 
*^ oi ihstiitutions whose primary Jf unctions are operations include /the ' 
law enforcement 'agencies (municipal, county, multi-county, state and 
0 federal), .the. courts (municipal, county or cirddit^.^tate and federal) 
and corrections (municipal, county, regional; state and federal) The 
\^>Br ag^encies which have specific R/D&I components (such as research, v 
development* or evaluation^ are generally the larger state and federal 
,^ agenclt^s and the larger cities (New York> Chi^^go, etc.^. Fot example, 
state^ and' federal ppl'ice agencies are heavily involved ^inv^^^ 
o data collection used by many other element;? of the criminal Aistice 
R/D&I ^y.atSim. ^State corrections departments often have research unit:s, 
u^^ed to 'df al with operational prpbl^ms. The gre^t majority of criminal 
•* ju^ice il/p&I system worjk is pet:foxmed by institutions wi^th such ^, 
fiinctlon as jKheir primary purpose. ^^^^1:iese xnst|l?^utions generally fall 
categories ^^jgove.rni/^ ^^^ncies, private foundations. 




into four 

•private ^^Bsearch orgahl^ationSii and p^rof essional 'organizat: 



Government agencies incluW the. previously mehtl^^ CSDC, 
^^^^f planning agencieii ^S^As) and^tf^^^^^ 
• ^. units . (RPUs)y Private foundations are. ';most,i>fi6^ the Ford Founda- 

'f - -(and its arw l^e J^^iice 'Fd^^^ Russell Sage Founda- 

^tion (Rettig 1976). -ifriyate researchjj^i^aai^atipris^ In^ddition to 
J ''unil^ersitles. include 'the Vera Institute^ jfe RahiOjalfesional 
,,. • ■ organ|,zatioiis include the Ameridan COTrect^^^^^ 

and the International Association ^jftchi The vast 

, . ^ majority of' R/D&I is done by^^hese stlj^i|ij^?ici^^^ hT 



those responsible for utilizatibn . f vW* 



■ 1>- Institut::^ns by R/D&I Funetioni^ ^^^Hlf V-^^iV??'-.;' ^ ' 

i: f'. ^^^^ tdentif ideation may-be d^tompii^K|d-i^^ the institutional 

•.^> -base. . LEAA, along, with th^SP^^;;^[n|g^^ Justice 
' ,.CQ9rdinating C6imittees, ||^^:prim need identi- . 

vf:^'-?'^f°"' . '''^^'^'^^'^^^^^ System (NCJIS) 

■ ^'^.ich'prpvlde? for .|^e_ gatljerfng^^^ national, criminar 
jjistice- system. stai^ltcff, vfrom;whifei|sii'*may be', derived. • ' 

, Researdri is priocipally* accomplfetted by the National Iifttitute of 

Law Enfo^eenjent arvji;. Criminal Jifsticfe ' (NILECJ) , «ie research arm of LEAA. 



W Of NlLpCJ hag t|ee^ explicitly applied in orientation ■ * 

cslnafe; its inception" (Rettigf^e) . NIlIgJ funds research* agencies 
to carry\out critnirial- j|etice~ research (e.g.: Rand or universities). 
.Research . is accomplished by other f ederal ^gncies' e.g. : DEA 
and Tr^iasury, .^aiid through -grants from prlvSe :^oundations .-(e.g. : Ford 
Eoundation),«^Research^performed in other sectors may h^e major im- 
plications Fdf 1^ fenfprcemerit; . e.g. : - communications, electronic data 
processing, ballistics and transportation (Wilson & McLaren" 1972). 

Develo]3ment activities are generally cai'ried out by the .same institutuions 
as" research, although users often play a large r'^role in this type of 
activity than t^iey do in resfearcW. Criminal justice agencies develop 
prograns> o#t*^ based orts^esearch conducted by; other instituticms. 



Business "firms jnay take a rese'arch idea from another sector and develop 
it into a product usable in the criminal justice sector/ 

' Production is handled by the producing companies, such as Motorola for 
communications equipment or Hke Xerox in more software oriented pro- 
grams (e.g.: program learniiig materials). Ther^ is a large variety 
of business"" organizations^ involved in tho^ crimiriar justice R/D&I system. 

of many different, sizes and degrees of 3pfh^^'t±cat±<i^ni\ To the extent 

..''V.?' . , V , ■- ■ . ' ' . ' 

that production has to do with packaging an ''innovation in the form of 

a. new program or procedure, LEAA often has a major role. .v 

\ . ' ■ \ ■ • ... 

Marketing, Diffusion and Dissemination are generally handled by the 
producing institutio|j, of ten x/ith an assist by LEAaI Organizations 
like ACA and lACP play/an rimpor^tant dissemination role. \ ^ > 

Acquisition is perhaps the iMj or probfep, es^f^^ wh^re^he 
user institution (police, courtgr'or corrections) imist' commit funds to 
current, or future expenditure. LEAA is again helpful in providing ,,jgunds 
through the blick descretionapy pj-ogram which may be used to initiate 
innovations, oBt the problem of ^ntinuat^ion -fuhdiilfe lo^p*?large espec- .^^ 
ially in non-e*quipment type gti^nts^ (e, g. : programs) ™Kit contain the 
implication thalj local funding will pick up the cost in a few years when 
federal funds run out. Beyond the. above issue is the reluctance the 
courts have in a ^ep ting any money from an execut^ive branch ageijcy, 
since thiit may upset the checks and balances provided by separation of 
powers. Most of the criminal justice system is^^s/y^ery labor intensive 
and the demands on the available funds are such that an increase in 
expenditure of local funds for new equipment arid i)iew,<^programs is often 
very problematic* Innovations may be^^^funded by expenditures- made when 
replacing old equipment. The^ differences in technical sof^Rxstica^ion 
of the criminal justice system's /purchasing decision-maker arAj the 

oducer's marketing staff mi^|i1: cause^ difficulties in' this acquisition 
phase.' r ' . 
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The user institutions would b^^^def inition be involved in Imp3.eaentation . 

Support may coae from other institutions (e.'g. : • police' (Jepartments * 

helping each, other) in cases involving the introduction of new sophisti- 

. ' ■ ■ ^' ■ 

cat^d equipment- Technical assistance may also be necessary In the 

event of the ^foplementation of a new program, such as t:he Release on 

Own Reccrjgnizanbe programs, 

. : . ■ ■ ■ ' ' . . 

Evaluation should involve all the institutions wlf|||^re part of thftk^in- 
novation- Iri practice, the principal responsibility may li^ on the part 
of LEAA which has funds for evaluation purposes and a congressional 
mandate to evaluate. The user would tend to do some evaluation of the 
• innovatiorilllbut generally a very unsophisticated evaluation. 

2; Clustering of R/Pgl Functlpps 

The"Structu^,of the criminal justice R/D&I system is looped rather than 
# lintfar. Many institutions are involved at several points in the process. 

The clustering of nipst functions is around LEAA, whfch has funding, 
^ research, development, production and evaluatiom responsibilitdjis, not 
to mention technical assi^ance to others. There seems to be the usual 

■ . : . ■ • p , Its, . " 

type of clusterirfg on the part of jJljbivate businesses involved in the 
% R/D&I process, principally^^ development , ^production and marketing. The 

users maj^have some relation to other R/D&I functions (e.g.: some 
^ ' polic?^^ii||^ an^ development units). 



'InstitlrtAonal Linkages 



ERLC 



The institutional process of R&D in criminal justice Has been described 
as a "loosfe network" <lue to (Rettig * 1976) 2 

1. th^lack of^n R&D history, creating barriers to a^ comprehen- 

■■ . ' ' % ^ ' ' • 

sive network; ^ 

:■ ■ ■■ • ■ .■ ■ - 

2. boAds be^^^^eri R&D. usfers^^^ weak ~ therJ^re few linkages 
jjirhl/f^nd between bhe^ sub--systems ; • * . m>- ^ . . » / 



- 443 - 



3. the establishment of b(!^nds between R&D arid, users are 



not,'^^ the result of research; and 



st^atytes limit . the roles of R&D inRitutions in implementa- 
i'ioyi >pa in the federal government. 




An exception .fb this may be NIMH's Center for Studies of Crime and 
Delinquenc:||^ is a "total Center". Thif^vinstitution has among its 
r^9pbnsib|jlj^ development of a coherent R&D program, including 

' implemen^a^^^^ the ;Linkages within the subsystems 

^^^fC^ Vej^^ The associations, within functions 

'^^:ih^'mBi^ M tK^^^cn^oT op^xhk^ provides some exception 

^^'j^^^e S*t^^ professional associations ex- ' 

ct^n ideas/^n?l|l?^^ innovations. At mbst levels 

* ' 

ritl 





ir:^jtistice R/D&I system thete is more of a 'compe- 
^og^jpefratl^ (university research versus 

'p|> ;c1ompetition for limited funds, this proble 

^fiSi^'a^ Illinois Regional Pianning Unit which identified 
coordination ^ a major priority (Greater * 
and *beVelq^en^ Com^nission 1977) 

'C ■ ■ ■ ■ . 



••• ■ ^ ■ • ■ • • 

• One nay profitably .review the Section on historical development for tt 
N discussion of the goals of the MLECJ from its inception up to current 

plans. Regarding 4he criminal justicie sector itself, the bringii^ tc^ 
gether of representatives of the three major sub-sectors (police, 
ipourts ^nd corrections) on^ criminal justice ^^{inning commit teet has 
'accentuated'the- differences in goals, policies and^ttategies. Even 
the overall system^ goal of reducing or at least^ containing crime is 
not aj;?:eed upon. Beyond that, 'l!here is almost no-^agreemen^p^mong the ' 

• sub-sectors or even within them. as to what Is lij^propriate politjy and 
strategy for the system. ThU opportunity' for- innovation (at least 
for successful inry)vation) is .severely limited by the lack of goal 

.conSeasus on the part^-pf^jei^^ institutions 7^ Programs 

which cross sector lines are* very difficult to implement, and even 
within-sec tor programs, may. be undermined by other su^-sector insti- 
'''tutions (e. police arresting 'work-release residents on suspicion, 

^Ipauslng them tcf lose their job©) . The hope of reaching goal consensus 
in^^situation of function accountibility'as vety slight. System v ; 
ar^oiinMbillty migjit reduce the current goal conflict. 

2> Functions j^". | ; » - 'ji^,. . 

LEAA and NILECJ have institutionalized these f unctional^^diff enances ' 
by setting up separate program areas^ f or courts, policii and: correctloi^s. 
The fragmented goal structure of ^this lead agency the"^efore mirroors 
the fragaen^d and conflicting goal structure of the' sectoi^j^lEt is^gadingV 
More fifpecifically, R/d&I activities in the criminal justice sectoi^ ( 
indicate thkt attempts are being made to develop guidelines that wyill 
be useful for siting up goals /policies /strate'g^^ that are less 



vulnerable- to the passag;^ of specific new legislation. Also, attempts 

" ■ . ' . ' ' ' 4* , . ...... 



c^re ensuing to draw together many issues on the conduct and management 

R/D&I activities that have been frequently raised in the past, 
The.concern here is to serve- as an important resource^for criminal 
juscice {Policy aakers and to create guidelines for the conduct of 
R/D&I in this sector which .will serve wjell during the next five to 
ten years (TrCJR&D 1976), ,,It is just beginning to be recognized, for 
example, that an ^approprfate balance must be struck between the 
allocation of funds to basic and applied researc!|; atid to the achieve- 
ment of short. Intermediate and long range goals- 

. 3> New Strategies ^- ' ^ 



As discussed under the sect^^^gn historical development, NILECJ has 
' moved from a goal of encouraging basjc research; to oile of reducing 



crime; to improving the crim 
shifted froz: niany smatir gran«4 

to operating agencies; to thdi^. 

..¥r 

Policy has^shifted from bei'i 
viding sJ^P|fi Mi^i J5;ftC7^tion pro 



NILEC;^^tii 





system, StrategiiS have 

ies; to a few large granta - 
grants to many institutions. 

ei of innovation; to pro- 
e^^'QLif.rentv thinking of 



Ration, process . 



I' 



traftbrsv changes in ^{ILECJ diirectorship, changes 
es in Congress's attitude towards research — 



Changed* 
in publi 

"^11 continue to buffet this key ^ency ijjp the criminal justice R/D&I 
system. 




m 
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V. ADMINISTRATIVE PROCESSES 



l4c 



1. Administrative grocesdjft "by R/D&I Function ^ 



Administrative processes^n the criminal justice R/Di>sy8t^fir are ^ 
best understood by emphaslzingvthe difference in the organtsatlOns 
found at Various points in the systeml 



At the research and at the 



relopme^ stages* the system 'includes 
organizations from both the private and public sectors, inclxiaing 
private profit organizations, university research centers, federal 
agencies, and professional associations. Few general statements 
could adequately characterize the administrative processw*. of thede ^ 
diverse o^aalzatiohs. The level /f sophistication of i^*^ processes ^ 
of some of these ^Organization's is high and is representative of 4!he' 
rtype OTi5^||t2atiot^ (i.e. f ddteral %gency^ private proi^fijt organiza- 7 
tion§, etc.) rather tihdn a reflection of the criminal justice sector : ^ 
The level 'Of sophl^^^^tion drops af5 markedly in other organizations — 
e.fc;.: eM^ller. bus^B?^ firms,' univeirJ^^^ Vv, - ^" 

■y ■ - . ' , ' ■ ■ " f .\< 

At the production, matiieting kad c^fstribution sta^s the systetiri more ^"*^' 



prominently Includes private organiz^lLons and these orgatYizatiortK 
reflect the diversity of sophist^ei^l^^^ of Administrative processes 
one would expect^ *to' £i|^ . in a widS^^sortm^ht of technologies and 
. organizations, ifhe level ed soph^Jfc'l^j^,^^ is generally^though 
with some variation) fairly liSgh 'aii^'7l4^n6t^sCK^ 
participation in the criiainal justice il/D SI-' By.^^ 
other organisational characteristic^ ^size, techniilro^, 

'^e fun(ij||bns such ||p .aaquisitio^v implementation, uttlizatiOii and 
evaiiia tibnip^are . primarily associated iJji^ user organizations , • 

(e.g.: police departments). There Is -wide variation in user agencies * 



TV 



in ter^ of size and level of sophistication, thus resulting in a 
similar variation in administrative 'processes . 




The administrative processes of organizationa in the R&D stagey of 
the R/D&X system are more spp^stlcated when <^6{u^^ to the user 



organisations. However, any general statement* 5nust be amended with 
a caution to distinguish, within any general catego^, between 
organizations of different siz^s, with different pcpduqt lines, etc 

\ 



2. Administra tive Act ivitj^Hhfjtttte Criminal Justice System 

■ r ■ 

Policy mkkers in criminal justice R/D&I are ger^^ally government 
employees at Ithe federal^ state and local unit of government level, 
and^ in that^capaJlty they (feclde what kinds ^f research should be 
supporte4^TFCJR&D 1976). • ^ 

R/D&I activities in criminal justice are conducted by university 
gr^lplh, non-profit organizations, |ia(p government operations. Key 
policy decisions re^ardin^ these activities are often not made by-^ 
; practitioner agencies but father by the agencies that sponsor or * 
fund R/D&I projects. Because criminal justice R/D&I has become 
relatively centralized, with a few federal agencies supporting the 
bulfc^of research (LEAA, HEW), the federal government exercises mqst 
ib^l^he decision/making power Qver the scope and direction of R/D&I, 



A ... ^ * 



Ylhg^rticularly when it is not^^ti response to a specific local problem 
^'(TFCJR&D» .1976)' 



Some coordination does exist within and among criminal jiHtice R/D&I 
agencies, Notajjhfe examples are coordination by the SPAs of the 
regional planning units, and coordinat ion of the state planning 
^gencies by LEAA. Cooi^dination at other levels and in -otHer insti- 
tutions c^n be, enhanced by crpss-institutional boards serving as an 
instrument to coordinate overall policies that Affect criminal 
justice R/D&I agencies in. general (TFCJR&D 1976): 



' • r ■ 

3. Administrative Procedural Considerations 



Four inpbrtant ina^||^erial procedural Considerations have been des- - 
cribed for the "ptoject" process (TFCJR&D 1976): 



1. Preproposal interaction between R/D&I agency 
staff and prospectl\Qft R/D&I performers; 

.2, A formal process by w^ich research proposals are reviewed 
and grant oi? contract award decisions are made; ^^^^ 
^ . ^ 

3. The monitoring of funded proposals; and 

4, Evaluation of results of cbmpleted projects. 

Although these processes are Important, and being performed within' ^ 
the LEAA framework, the ultimate indicator of the adminis trativa. 
process of R/D&I in a problem-focused s;^stem such as criminal J^^lce 
is whether or not Innovations are implemented and have an impact on 
the system. 



yi. PERSONNEL BASE 



The Persoanel Base is a critical aspect of any organization qr system. 
This is particularly true in an R/D^jfR^ystem which so^heavily involves 
the human component — as does the criminal justice R/D&I system. 



1. R/D&I Personnel 



Two types of personnel are Important in criminal justice as in any 
kind of R/D&I activity — managers and investigators.^ T?he quali-*.. 
' fl^fiatlons of these personnel directly affect the quality, relevance 
attd iitlfity of the R/D&I systeA> ^ 

Despite the/^iff4?ctllt5y in establishing g>4^ines for the appropriate 
ampunt of t^inlng^nd experience for the professional staff, com- . 
petent R/D&inSnagement is an essential objecj^;^ foif the' r/D&I 
agency funding especially in an applied research area such as 
criminal ju|^tice. 

The following is a^possible^ description ^ the personnel base of a, . 
fund*ig agency as propcj^ed in a recent report on criminal -justice 
R/D&I.^^cb'an agen^^^ staff shopld contain at least two oif "tfree 
leadnit^'^embers who hal^e a significant research status and^fit least 

°"5f^^^^.^"^"^''' "^"^^ f '^"^^^^"^"^^'^"^ and political sKills. It''"' 
is :npt necessary f^ the ag_ency herfcf tp posses's all of these sM^'J^^' 
administrative ^iT^litical skills' loyld be more ilnportant '^Jljr this 
, individual thari 'research skills. m^^,^as a total st^ff^all 
°^ ^^^^ skills, should- b'if well represented " (TFCJR&D 1976). It 
is ii/teresting to note the recognition of the required blend of 

skirls. 4%*^ . 
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An example of an agency with highly trained personnel is the/ 
Nl>3i*s Center for Studies of Crime and Pelinquency. Their ^ 
staff of seven includes two psychologist;^ (one ;clttijUca^ ^ v'# 
one political scientest, one aQ^^||ychologi*t;v«^^^^^^ • 
ologist, and one social worker. ' ^Th^fBit^^ strongly orieAted 
towards the research performer conanunity and is considered one 
. O.^^the more competent R/D&J instit^ions in the criminal Justice 
sector (Rettig 1976). Their re'spo^aibiiities include making • 
pres6iiWtlon3 at meetings, writing articles for practitioner 
journals, dissemination* of information regarding available 
grants, working with prospective grantees on proposals and 
concept papers, etc. 



There are few available prescriptive criteria for determining 
desirable professional staffing patterns. sq^ested (TFCJR&D 
1976) optima^ staffing pattern is one based on an ir^pendent 
assessment that covers the relationship between the apisition 
o£iifgH quality R/D6el person^ and the recruitment, retention 
and work load policies. Such an assessment can be supported by 
the R/D&I funding agency itse;Lf or by*agencies of private organ- 
izations conceimed with perscj^el management. 




Some problems have been ^jjjj^PLed.by the TFCJ^&D report regard- 
ing criminal justJlip^ personnel for .R/D&I. Dua to the recent rapid 
• growth of available fui*s for R/D&X ift ^the xs^J^uf^ sec- 

tort it is difficult to achieve adequate levels of competence in 
/ research investigatoli. .The availabilitgr of funds resulted 

in a sharp incrifese in the number and types 6f researchers who 
do criminal justice R)8&I activities. Although formerly con- 
. slsting of a research community, currently R/D&I per- 

' - sorrnel come firom' widely^ scattered backgrounds including account- 

^ l^^r operations re||parGh, economics, political science, 

engineering, archi ^* 
before thfey can. be 
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2* User Personnel ' ; 

. ^- " ■ '• 

Crlcinal ju.^Uce agencies (user organizations) are labor Intensive. 
Since usi|jp or potential adopter attitudes towiird innovations Are 
critical to the rate of innovation adoption, the criminal justice 
R/D&I system faces a foraidable obstacle in the personnel resources 
of its user organization. Some changes are being att^ijpted by ^ 
up-^grading the selection criteria (e.g.: college educj|l>n). . ^ 

Some distinctions regarding personnel mu§t be made between %be 
various functions within a, criminal justice agency.' To the ex- ^ 
tent that various functions (e.g.: in a police operation: pa- ^ 
trol, Iny^tigation, deitectionv:retc. ) become specialized, ^he 
personnel resources must also become more speciaiizedi Thi3 
specialization can lead to gteater rates of adoption of some in- 
novations. For example, diffusion of communications innovations 
can be greatly assisted by the existence of communication special- 
ists. in the police departments. V Logicall}/, such Specialization 
leads to greater awareness of .available innovations, greater support 
far their utility and, in general, represents a greater source of 
"product champions'* wlAln the user organization. 

This specialization of personnel also can lead to efforts foK .k 
some specialization to. aspire to a p^ji^essional status. Vc^^ 
organizing of dssopiations of specialties such as cctepiunlcatlon 
officers, or^fbrena^ laboratory managers, is evlTieac^^of ,such \ 
a professional directions This movement could encourage inno- 
vation through prwiding d vehicle for dissemination. 

■<;<:^- ■^-'^^'i" ' " - ' ' 

LEAA M.Ticjfrlpingy<;.rim^ justice jpersonnel to Increase their'^^ 
sophi^l<a|^iph>^a^^^ ti:airiing. LEAA also fund.3 univer- # 

sitieSS^wi*^i»e^!^^^ programs through LEEP (Law 



Enforcement Education Program). Northwestern Uni-v^rsity's 
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Traffic .institute program Include'ai, ol^^urtfc in tnanage^m^nt of change 
•-.T.ich directly., dqals with Innovation/ pjfdcesses. 



As professions from other disciplines interact with criminal 
Justice personnel, both may become^more effective participants in 
the.crlrinal justice R/D&I , system. [ ^ 
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Vrt. FUNDING 



1. Sources 



Expenditures on the criminal justice system during 1975 at all 
levels of government (state, local and federal)^ ar^ estimated 
at $16 billion in 1975. The total expenditures for the R/D&I 
system are estimated^ at less than ^/o (Rettig 1976). Regarding 
the total criminal justice sector, the aources of funding are 
appropriations of governmental bodies, s'uch as city councils, 
state legislaturei^, and Congress. Like all other governmental 
activities, the level of funding is rarely adequate to mee^ 
the needs', but it has .been rising steadily over time. Between 
1969 and 1976 there was an i>ver 800% increase in criminal jus- 
tice R/D&I funding, from $13,443,000 in 1969 to an estimated 
$110,223,000, in 1976. This increase is principally due to in- 
creases in' the LEAA budget as shown in Ffgure I 



Agency ^ FY1969 

Federal Judiciary i . ' ;67 

Dept. of 'Defense 0 

HEW 5,773 

Dept. of Justice 6,413 

J)ept. of Transportation 519 

, Treasur^ 0 

Others . 711 

Total 13,443 



FY1976 <est.) 
3,700 
20 
4,267 
9i3,154 
3,231 
840 

110,223 



FIOURE ■ 1 ^ 

Crime Research and Statistics — U.S. Go vernmetfl;^ Outlay by Agency*' 

($ in thousands) 

* TFCJR&D (1976) : 
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Various private foundati/ons; support researcli'ln this sector. 
(Ford Foundation, Gugg/nheln* Foundation and Russell .Sage) . 
In soae c^ses, funding, for research, is different to separate 
from action funding. - l,aw enforcement surfaced >s a major 
political Issue In the 1960s, an^ this led- toj^^he passage of 
the Omnibus Crime Control^ and- Safe 'Streets act^ of 1968 which 
provided the funding for criminal justice system activities.. 
The committment /to this issue (as - reflected by the funding 
and the amount AJf controversy surrounding the hearings) after 
a period of sjieady growth, has now leveled off — 'lEAA' pro->- " 
vldlng approximately $800 million ^mfually. This reflects 
a small coimnlttment' relative to the total national priminal. 
justice budget as follows:' • ' • 



/ 



■ / 

/ 



4 


c 


* ... ..* .. 




Year • 


■ Perc|i|tage-; 


/ 

• J 


1967 


0,16 




1970 • 


0.15 -V 


i . V ■ 

/ ■ ■ * ' 

t ' 


197i 


0.22 
0.24 


1973 






• 1974 (est.) 


' 0.46 . 




' ia'75. (est.) 




e 


- „ : FIGURE 2 ^ 


• - 






*7 



Federal R&D as a Percentage of Total National Criminal Justice 
Expenditures (TFCJR&D, 1976) " ,. -4 • " 

This conlpares to the following percentages in 'other areas (Radno 
Splvak and Hofler 1977)'. . * 

■ . ■ ' '. • . . .j; 

Education. 0.3% " • 

Agriculture . " 

, ^^^^^^ ' ' ' ' 4.6% . : •. 

. Industry .3.4 5.0% 
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The two largest government criminal justice R/D&I institutions, 
NILEGJ and the Center fort' Studies, of Crime and Delinquency (CSC&D) 
' have -the following funding (Retti^ 1976): 



Year 



Funds : 



Appropriated 



Expended 
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69 

70 
71 
72 
73 
74 
75 





Funds 



FIGURE^ 4 
NILEGJ: 



appropriated and^xpended FY.1969 to 1975 
/ ($ in thousands) ^ 



the CSC&I)''has. an annual opefating budget -of 'approximately $^4 million- 
The^e funds are Expended in the iapproxiraate ratio of ' 60% resjearch 
and 40%' training. - *• 



In. the private sector,^ the major funder is the Ford •foundation, 
5}tpend^ng $70 million in' grants, between 1951 and 197ot Addi^ 
tionaflLly,»;.Ford endowed the Police Vp^ndation \with $3.0 |millibil 
(Rettig 197^). \ 

Although ilo detailed analysisSbas bi^/perform^^d, the rjesearch 
tasrk fcrcje of MIMH reported that research on s^cia^^jpijculem^^ 
inctlldifig crii]^ and delinquency, is underfunded (Resparcn Task 



Force 1975). In s^i^e of the fact that funding has inc: 
signif icaPhtly over the past decade, law ertJEorcenl^nt and criminal 
justice .are not especially R^cD int*ensive as a policy area . 

> " • . ■ • , ♦ ; 



eased 



As Indicated/ the federal government is the ma^or. source of R/D&I 
, funds in' criminal justice. Milfch of this money is; spent by' non^ 
federal .government agencies: Slightly less, than 28% ot the tot^al 
Federal R&D^ budget is spent In .government 'labs (federal Funds 1974) 

^ • '.■ ' ■ -.^ ' 

Most of printary sources of funds are in the form 6f appro- . 
priations^(e.g.:^ongress appropriates to LEAA) . The secondary 
sources t^end to be grants iisually on a sole source basis. There 
is soiJ^. c^p^tive bidding for grants and probably more for 
contracts .(^pecially on a RFP basis) but the decision b^gis 
Is^usuah.ly.:c0mp6tence or considerations other than low bidder. 

LEAA funds almost exclusively solicited proposals. There are " 
3 types of solicited proposals* / * 

■ ' , ■. ' . ■. . 

1) competitively solicited (open) ; ' * 

" " ♦ ,^ ■ . 

/ " V. ' 

2) pompetitiveiy solicited (limited); and 

.3) individually solicited (sol6 source). 



Most funding >>s for limited competitively solicited proposals. 

, Furthermop^,<-i£AA must jnake a decision oi,, or suspend, a pro- , 
posal within 90 days; of receipt or the proposal is auttinatically 
furided, and" this arbitrary timetable definitely affects the 

. quali^ty of .proposals. (Rettig. 1976) . - y" 



2. impact 



Availability of funding becomes an "even more crucial issuexat 
the user level, when state and local governments are asked toC. 
use local tax reVetiue Ip acquire and implement innovations o^ 
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^to continue federally funded programs.' These funding probleqis 
may result in limited success of the 'Wrketing" effort The 
state and locar response to the "seed" .money "approach of the 
block grant program has been in many cases to use the money for oqe 
shot expenses (equipment* training, constructioh) • This mini- 
mizes the impact of the program- on future, local tax revenues 
(as opposed to a^efHf program which would require new*staff and v 
commitment of continuing f.unds). . , 

'» . - ■ . ■ ■ . . 

Many .criminal justice system agencies actively seek LEAA funds'^^ven 
though grants repiresent a small percentage of their total budget 
since operating budgets provide little reisources available^ to 
fund innovations. * . , A 

The private sector (industry) evidently does not see enough Qf 
a return on investment to do nn^h direct research on criminal 
justice system innovations (Radnor 197^). The basic research is 
often federally funded or most commonly done for some otlier^ sector 
(e.g.: pommi^ications technology for the space program). The 
Equipment Systems Improvement Program (ESIP) program of NILECJ was 
an example of trying to involve' the private sector fji research 
Activities in the innovation of new equipment for law enforcement; 
.through ^e provision, of fedetal fundfl^fRadnor 1975). In sum the 
most critical issue from the view .of this analysis of the area of 
funding Is the funding for the acquisition, "implementation, utili- 
zation and evaluation of innovations. Funds must be obtained from 

the . state and local' revenue^ bdse and criminal justice agencies 

^ \A ■ .' . * 

often lose out in the. competl/fcion- with agencies serving other ^leeds. 
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VIII.- INFORMATION FtXM * # 



1> Current Situation . ^ 

Informatibn flow in the criminal justice R/D&I system gen- , 

{ - ' ' . ' • / 

serally coincideB with the net^work of institutions in the 

system, -There tends to be lateral transfer of informa-* 
tion ijetween- units with similar functions, particuiarly 
at the user and re&e^rrch Icivels. User organizations seem , 
tQ> communicate freely with each other through both formal 
and informal networks. Research organizations, particular- 
ly at the federal or national level, aeem alsp to interact. 
The differen9es in levels of sophistication at the tWo 
'ends of the system tends to impede the exchange of infor- 
mation between levels. ' * 

Most commuiiiication between criminal justice user organizations 
are informal, with respect to transferring infprmation about 
innovations (Radnor 1975). There is considerable informal con- 
tac|:, particularly at local, state and regional meetings and 
convention^. In a few inst^ces, these Informal contacts have 
evolved Into Institutionalized systems to communicate and cooperate 
in efforts to introduce Innovations into the organizatioA. 



The informat;ion transfer takes place, for example, pot only 
^"etween chiefs of police at conferences sponsoLed by the* 
International Association of Chief s ^f Polic^j (lApP) and by 
local and state associations,' but also at thfi more special- 
ized/professional gatheritigs, such as the Association of 



28^ 
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Public Safety Communication Officers (APSCO) . Such con- 
ferences* appear to be^vital in the transfer of innovation 
information. Professional organizations serve sijoiilar in- 
formation trahsfer functions for the' courts arjid corrections. 



T 



Periodicals and magazines, such a;y Police Chief and Probation , 
are also important means of infdrmation transfer. Such 
periodicals not only make usera. awarej of available innova- 
tions but also provide a degree pf evaluation oiE some 
innovations. 



Of particular importance in the transfer of technical 
information for police is the lACP publication. _ .It pub- 
lishes peri9dically (monthly) detailed ^information sheets 
regarding specific law enforcement equipment and supplies. 
Such in£ormation includes description, performance spe^cifi- 
cations, and manufacturers. The ^ ^ame^ organization pro- 
vides, for a fee, an evaluation service for any listed 
products (but not, if should.be noted, at a rigorous and 
sophisticated leyel*) . .- 



V 



The National Institute for Law Enforcement and Criminal 
Justice (NILECJ) pl^vides an information diffusion SeWlce 
(Rettig 1976), primarily for information about activities 
sponsored by the Institute. One category of information 
is the standards for criminal justice equipment developed 
^by the National Bureau of 'Standards . However, Radnor (1975) 
found little -use of these standards by either users or 
producers. ' The^ uaers found them too«sophlsticated .techni- 
cally;*" the lairge producers' felt they neither needed nor 
wanted government imposed standards. 
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Problems 



One .major problem in information flow of the criminal 
Justice R/D&I >ystem is ^derived from a fundamental prob- 
lem of the criminal justice sector; the lack of a dohe- 
sive network with agreed upon goal^ and priorities. The 
• criminal justice system does not function as an integrated 
structure, -striving to achieve the same overall gpals and 
with some agreemerurots^ appropriate strategy. Rather it 
is a loosely linked stijlicture with major disagreements on 
strategy and with strong political pressures on agencies 
to optimize their indleVidual goals, resulting in subgoal 
ogtimization for the. system. Thus information flow within 
\ the criminal justice system, but across function lines, is 

restricted by disagreements arid competitiveness. 

\* . . 

4 The freedom of information/right- to- privacy issues affect 

'the flow of information from practitioners to researchers, 
particulaty the flow o£ raw data and its verification. 
This results in the duplicate dollection of^^^he same d^ta 
by various R/D&I institutions in^^ome situations, or soi^e- 
tim^s the inability 'to collect needed data at all in others. 
■ . . * ' •* , 

f A third problem (as noted earlier) is that differences ^in 
V^^. levels of sophistication Jb^tween the knowledge production 
\ and knowledge utilizaition parts of the criminal justice 
R/D&I system tend' to impede exchange of information ^ 
between them. 



1> Tvo Alteimatlve Flows ' \ . . ^ 

**In ar) applied ^system, such as criminal Justice, Innovations frequently 
may not stem from a laboratory or from university research. Figure 5 
below describes two altemattve l^ovatlon flows as described by the 
Task Force on Criminal Justice Research and Development (TFCJRfirD, 1976) • 

As the diagram shows, Innovations may be "practice-to-practice" 
or "knowledge-to-practice". Practice-t'o-practice innovations 
typically result f rom^employee suggestions, ideas from supervisors 
or other initiatives within an operating agency (user). Knowledge- 
to-practice innovations result from the traditional R/D&I process. 
Additionally, there appears Co be no known' comparison 6f- the re- 
lative frequency or importance of thfese two approaches to criminal 
Justice inno\'atio'n." This is an area clearly requiring further 
empirical research. 

• " -. ■ 
2. Successful Innovations _ \ . 



Although there have been Innovations, dramatic improvements have not 

occurred ±ti spite of substantial R/D&I efforts in criminal justice. 

A few e:fan5)les of successful innovaticms include the identif i-fiation 

Of a processing bottleneck of persons arrested for felonie's through 

a court simulation system, two-way radios for communications,* 

report recording devices, lights and sirens; polygraph equipment, ^ 

Voice4prints, r<to£ control equipment, architectural innovations for ^ 

tills ^ EDP equipment for offender based tracking systems, release ^ 

on own recognizance programs, community-based correctional programs, \ 

behavior modification programs, police patrol allocations, training 

ahd educational programs, forensics, etc. (Twentieth Century Fund - 

Task Force* on the Law Enforceme'nt Assistance Administration 1976)."" 



♦Although, according to- Radnor (1975) they Would not include the NILECJ 
supported program (see comments on this- in Feature XIV^. 



Source of Idii 



Criminal Justice Agency 
Enployoi Siugseitioni 
Progran Analysiff 



Etc. 



Intemedliry Step 



Ageniy-Agency Communication 
Vlilti 

Professional meetings 



New Practice 



Crlniinal JQsticc Agencies 
Implement new practice 
baaed on Innovation 



Sodrce of Idea 



RjJJ Facility ■• 
New Inventions 
Policy Research 



Intermediary Step 



The problem of converting 
new knowledge into practice. 



R&D vs. NON-K&D BASED INNOVATIONS 
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3. Problcmw 

" In criminal Justice tho focuH on specific Innovations to solve indi- 
vidual agaacy problemahas been tho major approach to improving prac- 
tice. K:?vever, as pointed out in th« section on institutional base, 
the criminal Justice network is fragmented and lacks a true' system 
interconnecting Its prftts. Although this foc^is^is on the specific 
me^^KS^lsras to facilitate the transformation of knowledge to practice, 
it rfeduces t;he prob^bltllty of any single innovation being- developed ' 
for the whole system^ oTr^-^CQr innovations being disseminated for use 
throughout thje s/stem. The resbit^^^s^^jalrrti^ "dramatic improve- 
ments" within the system. \ 

> Criminal JustlcW R/D&I faces ari addltlbnal Aajor problem- Innova- 
' - " \. 

tlons ar*d generally developed by groups that aire external to user 

' > ' ■ \ 

institutions. This requires dissemination and rl _ 

tenuous link between knowledge/ and practice. It also leads to 

implementation by the user agency only so Ibng as external funds 

for special "innovative" p'rojects exist (Yin et al. 1^76). 
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,yZSD- IDENTIFICATION . 
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I. Traditional-' Sources ^ / * ^ ^ ' ^ 

Declsiotts-bf the Supreme Court can affect needs, such as in the hand- 
,l4iaii^,:'of /drd,ipln^ arrests Or ,the conditions ±n which prisoners are houged. 
V Ccn]L^essij^^ in 'Administration of ten result ^ 



in new^ iviews as to what is needed and changes in previously established 
priorijties .among already existing needs. For example. Congress has 
adeemed that community anti-crime programs (prevention) are needed. 
Prior administrations have focused on crime in the street (apprehensioA), 
vhile one cur renrt focus is neigl^orhood justice centers (diversion)* 

In the criminal ^Justice sector , need identifiaatibn is somewhat Sl^ss 

-'.^p^ , ' m ■■' ■ V 

than systematic.^ Rather, needs are identified by Congres^, legisla- 
tures, the media, producers with new products to market, the public and 
institutions within the criminal justice sector. Much of criminal jus- 
tice need identification ife done by producers, who have pew products 
developed ^or other sectors (e.g.: communicationis'^echnology) and 
want to, identify needs in criminal justice in order to broaden their 
market. One might say the is€ue of police response tii^e was raised to 
awareness T?y the availability of improved coiliputer software for patrol 
allocation plus the availability of improved communication equipment. 
A heightened awareneas of individual or prisoner rights can lead po 

needs being identifie^ which always exist;^d, but were not salient. 

» ■ ■ ■ 

2. New Sources 



LEAA has the potential for the systematic assessment of needs, in its 

National Criminal Justice Information System (NCJIS). LEAA has 
recently instituted a mechanism for bringing identified needs to the 

at.tention of the decisiori makers: a formal decision memo. This memo 

specifies the need and proposes some general approach to dealing with 

the need. 

■ ^ ■ \ ' 



The 'JLEAA legislation (Part B) established q network for the identi- 
ficatiop; of needs by providing planning furids.^ This network- includes 
local criminal justice plaHnijig,; {involving sector institutions, 

.4 . * '.' T '■ - • • 

goVemmeat and: public -representatfdh. The needs identified are in 
the:^plans of the SPAs for e^cE state. Of ^course^ these local and 
ll*tate plans 'ar(^ at least as'sxibject to political ajad ^p-ecial interest 
pressures as ^ the ^ federal plans, 

,!I5ie reseai^ch arm of LEAA, NILECJ, also identifies needs through surveys 

and analyzing criminal justice data! The NILECJ responds to requests . 

.... ^- ■ * ^ ■ • 

from the. action program offices of the LEAA' organization to research 
needs that the progr^ people have "^identlf ie<i.; responds to requests 
''from the iadminlstration^to pursue needs that the administration has 
identified; responds by funding a university to look into a need which 
the university hag identified; and responds to nteds identified by - 
Congress in the enabling, legislation. * 

. ■ t • , ■■ . . 

When the criminal justice system develops^ a more systematic approach to 
need identification, lEAA in general and. NILECJ in part^.cular* will-be 
in a stronger position to buffer the agefxcy against tffe more random 
identification of needs by various actors outside of the system. . ' 



XI . GENERATION/RESEARCH 
!• Basic Research 

% — — : - 



Basic researck In terms of search to determine what knowledge alreaHy ^ 
exists^ creation of. new knowledge ^and synthesizing existing knowledge 
is very limited In the criminal.^3lu§tntce sector. This is because most / 

..-'^••^ ' ■ • • . • . / : 

of the effort isl on applied research (problemr-f ocused rather than / 
"pursuing" knowledge). It is the basic research of other »ydisciplin§is 
su&h as sociology, psychology and operations research that is uti/lized 
in the criminal justice sector; i.e. , it Is a derivative field. v/There 
is little direct transfer of pure knowledge from, the other sectors to 
the c^minal justice sector; rather developed, products and p^cesses 
ar^/adapted in production or directly move^lnto the markejf^i^ stage 
(e.g.: communications equipment). Criminal justice basi^ research : 
is done in s one areas (e.g.; causes 6f crime, voice pr^^ts and 
forensicsTi This research is carried o^t by ^universities, private 
industry and government. 'f^ / 



^. Applied Research 



Applied research (disciplined inquiry seekin^^to produce knowledge 
applicable to the solution of a specified pifobleih, and either driven 
by an identified need or by searching- for/the application of the 
results of some basic r^seardh) is more /prevelant than basic research 
in the criming justice* sector. Again^ the applied. reseSrch of other 
sectors is more important to the crinuLnal justice^R/D&I system .(for 
example knowledge developed througl^^^ applie4 research on communications, 
various operation^ research activftlei^, etc.). Hfcfetitutions involved • 
in applied research 'are more numerous than those involved in basic 
research, and the intensity of the involvement is greater. 



3. Issues 



Sozie of the basic issues and ^considerations for criminal justice 
R/D&I include (TFCJRfiJ) 1976) : " i ' * 

• / ■ •* 

1. There is a need to better describe the rol^ of the re- 
searcher r^- his/her autonoiisr (or lack of it) ; balance ' 
between the researcher '3 creativity and agency goals 
ai^ priordLjties.^^ ^ 



2. As the majojity.pf criminal justice research 

involves human participants, tjiey must be pro- 

» '-^ . ■ 

" tected. The cutrerit sensitivity to individual 

/ 

rights of privacy and confidentiality, statutes 
and administrative regulations regarding informed 
consent, protection of sensitive data, etc, all 
impact the criminal justice researcher and his/ 
her ability to perform effectively and efficiently, 

3. The selection of topics ^fc^-R/D&I is difficult 
considering the lack of \system continuity (see 
Goals, Policies, Strategies) with their lack 

' of agreement. 

4. The choice of research methods. Which should be 
determined In relation to the type of R/D&J ac- 
tivity and its overall purpose, is difficult 
iueto the above issues. 

5. tl^lthough there hds been an increase in the amount 

of R/D&I effort in criminal justice over the 
past decade, there is still considerable need 
at the most basic level — development of compa- . 
table definitions, developing research hypotheses. 




designing research sfudi^es , and (developing sound 
orelationships between' the Research team and the 
user agencies (TFaJRVEL 1976) . ; 

fhere has been a majoi shift in criminal justice 
research "directions, Interest in individual per- 
sonality theories has decreased 'while ^interest 
In sociological theories has increased. This may 
be demonstrated by the "recent interest in the 
pattern of crime through the numerous victimiza- 
tion studies in the 1970s. 



DATA 



As alluded to iii item 2) above , there * are significant problems 
regarding data resources (obtaining data, and the form in which 
it is obtained). For example, in Illinois, obtaining data on 
juveniles frequently requires a court order. Additional difficul- 
'. ties have been identified in . the area of data problems (Bisco, 
Ralph L., 1970). Much of the data that has been collected is' 
unused. Geographical dispersion of the data sources results in 
not knowing what data exists, difficulty in determining validity, 
duplication and tremendous expense. Bisco states that it is 15,000 
times more expensive to collect data than to copy pre-existing 
data. 9oth the issues and problems are relevant to both basic 
and applied reaearch in the crimi,nal justice sector, 

5. Linkages 



The LEAA performs apd funds applied research trhough the NILECJ. 
This uifffc funds universities, private research organizations and 
other grantees to work on applied research. User agencies with 

■ J - :■ ■ 



new iajgproaerhes. to^ i^entifteti problems/S^ funded to try out \ % , 
1 ah innovation, ^aiid. as loijg ^as it Itjjfi^WQ^ tiisciplinefd inquiry it 
wouM come sender the 'category oT §ppli^Q "research. LEAA provides 
a linkage function and other aspects of the-R/D&I ' 

system. •The agenty may fund users to be^^a^le^to acquire 'the 
innovation, thus encouraging' further development, by a' product- 
Also, LEAA may fund a producer to develop the results of applied 
research. These linkages are imperfect, \>ut the agency is presently 
working on a system to strengthen them. This system. Action Program 
Development Proc,ess, specifically links action programs to research., 



*The process is currently being implemented with the assisfcancet of ' 
CISST staff. > ^ 



■ . ■ ( ■ . ■ ■ . ^ 

. Regarding the icriminal justice R/D&r system, development wqxk is 
^gene^^lly. accomplished by other sectors (particularly when related ' 

' to. equipment) , with only minor- adaptation necessary; "or by practi- 
tioners or users, testing out their Idteas (particular ly in fc'he ' 
development of programs) . Some equipment is specifically developed 
for this sector (such, as "Mars Bars", light flashing/siren systeW 

.for patrol cars). Producers do mucK^evelopment work in the equip- 
ment area, while users off ten fill ,tha|:. role in the area of programs, 
innovations of a process type ire oftpi developed by an operations 
research organization (e. g. : patrol car scheduling pro'icesses) . , 
The funding situation of the users often discourages the investment 
of private money in ,deve loping needed products. .Thus the. LEAA role ' • 
is vital in this dev^opment function. ^ 

2. LEAA Role' * 

■ ^ ' . ■ ■■ : ;■ 

The LEAA has tried to entourage private* investment in developv>ent by 
creating the hope that money would be made available to local agencies 
(through block or discretionary funds) for the acquisition of the . < 
Innovation. Further,. LEAA encour^ages development by providing market 
. research data through efforts at the assessment of needs of the criminal 
justice sector; 

^ipally LEAA engages in (arid funds Aethers toi ;.do) development work.. One 
major problem is. the wekkness o£ the linkages between development Shd 
users. LEAA is working on' imprp^^g these' linkages ana>l.s engagid in 
system building at least within ieg'^ somewhat fragmented ageAcy. 

,The activities engaged in under the riAric of demonstration usually 
include development efforts, while the testing activity fof ten in-' ' 



ciudes dissemination aleiients. The agency is trying to move the . 
criainal jij^tice^sectoi^y^closer to' a cleairet distinction between • * 
activities sfich as, testingV and demonstration. ' ^ ^ 

/Linkages between devielopers and users are be ii^ gorged with instruc- 
,t:ion manuals ai?.d ^support services, such, as training. Especially / 
in' rthe case of i^ew programs or processes , LEAA serves a key linking 
r6l6 by 'thfe funding of, or participating in production activities* 
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^ XIII > PRODUCTION . . . 
^ 1, Critical Linkage - . 

all flow of innovation from knowledge production to knowledge utilization. 
In the case of a physical product ( as opposed Pto a program or process) 
the decision to produce something especially for the law enforcement 
sector will be based on many factors. One primary factor will be the 
anticipated market for the innovation. Derived from that and other 
consideration's may be the anticipated margin or gross ^ofit. Further 
-consideration will be given to the ease of production in the existing 
facilities utilizing existing >equipment. How^ver^, often the product ' 
is already being produced for some other sector and therefore production 
is not really an issue for the criminal justice R/D&I system. % 

In the case of pfbgrams or processes, production becomes an issue of * % 

. mm; 

preparing instruction manuals and providing support in xhe^Kiowledge 
utilization 'functions (support such as help in installation, implemen- 
tation assistance, plus training and perhaps trouble shootiii§). Thus 
there xs a' strong interaction between how well the prod\ic^tion is* 
acc.onq>lished and the amount of support services required down 
' the road, not to mention the marketability of the program or process. 

It £iB probably key, in the case of a product, to obtain answers to -the 
marketability and profitability questions prior to the investment pf ^ 
major research and development funds ; an^ to ascertain the likelihood 
of finding a producer. 
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2. Recent Initiatives ■ ^ 

LEAA (through NIl.B|CJ^under.took a program in the early 1970s to 
advance the equipm^t-4iglng used in the c^minal justice sector. 
The program was called ESIP (Equipment Systems Improvemelrt Program). 
The program had maiiy problems associated. with it, including a number 
related to production. At least In some elements of the criminal 
justice' sector, tliefe was seemingly sq little hope that a profitable 
ajarket could be found (in terfiis of local fimding ^availability and 
other problems) that producers could not see a price/volume, com- 
bination that would justify investment In volume production, and 
hence were generally not attracted to the new products addressed in 
the ESIP activity (Radnor 1975). To some extent, a very broad demon- 
stration program on the part of LEAA (e.g.: to inq) rove prison \ 
overcrowding) could possHbly function as insuring enough of a 
market to entice producers to invest In an innovation. , . 

A notable example of the difficulty in production for the criminal 
justice sector can be found in the communcations area. LeAa sponsored 
the development of a lighter, less expensive and more efficient 
portable radio than current equipment. However, upon the completion 
of the development. It was unable to identify a producer willing to 
assume production responsibility (apparently due to the likelihood 
of small returns). Consequently that particular portable radio 
has never reached the users for which it was intended (Radnor 1975). 

To some, extent LEAA produces -^'packages "^or dissemination (see the 
section on dissemination). Production takes place in two forms — 
"exemplary programs" an^ "prescriptive packages" which are developed 
for dissemination as many -prospective users as possible. The pro- 
duction .is ^some times accomplished by outside contractors as a result 
of direct funding by NILECJ (Rettig 1976). 



The production function in the criminal justice sector is perfpi^^ 
by. a wide variety of organizations. Equipment is produced*' by / ' . 
private, for-profit firms which range fromivery small to ve^ large 
in size and which may focus on criminal justice as their primary 
market or (more lijcely) may consider criminal justice to be a 
secondary ma^et (Radnor 1975). Production cyf "packagesV for 
dissemination X"exeiq)lary practices" and "prescriptive packages")* . 
is provided by" NILECJ through its funding of outside' contractors 
(Rettig i9'76). ' \ 



*See section XIV on Dissemination. 
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•. XIV. >'L^^TING/DISTRIBUTlON/DISSEMINATION/DIFFUSIO?f 
1 . Maglcetlng 

Of the above categories,, markettng is^ost applicable to the -equip- 
ment aspects of the criminal ju&tice sector, vhile dissemination is 

appropriate for the procedure and process innovation. This major'' 

i » ' • * \ ' • ' 

linking function between knowledge production and knowledge utili- - 

zation Is an important consideration during dfecislon-maklng activi- 
ties 6f the prior stages. The production declWon should^not 
(but 6ft en is - Radnor 1975) be made without considering marketing 
opportunities and strategies. To the extent t|iat the criminal 
Justice R/D&I system^ driven by deed ldentifica|tion at the user 
level, and that the acquisition Issues have been considered, then 
the marketing decisions would be made early in ^he process. lf_ 
the user has the funds to acquire tl^e Innovation an^ recognizes that 
it is in response to needs that he has participated in identifying, 
a receptive market should.be found, though these conditions seem 
frequently to be absent. To the extent that LEAA pirovides seed 
niioney funds for the adoption of innovation, dissemination may also 
be facilitated. \ 

2.. • Problems ' \ * - 

Marketing -^nd dissemiaatioh in the criminal justice' sector are faced 
with the problems of a fragmented and diverse grouping of organizations 
which function at all levels of government, which vary extremely in 
sfze and sophistication, and which are geographically dispersed. 

A notable example of the diffitrulty for the criminal justice sector 
cap be found in the communications area. As mentioned before, NILECJ - 
sponsd^red the development of a portable radio intended to be lighter, 
less expensive and more efficient than current equipment. However, 
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upon the cospiecion of a relatively successful contracted out^ 'develop- 
' ment progran, it was unable to identify a producer willing to assume 
marketing production and field service (a very costly factor) re- 
sponsibility due to the likelihood of small returns- Consequently 
the* equipment h^ never reached the users for which is was intended 

(Radnor 1975)*. 

, ■ «k» ■ ' 

The problems of communicating information about a neW product to a 
large urban police department are vastly different from dealing with 
a small rural enforcement activity. ^On another dimension, differei>t 
orientations are present across various parts of the criminal justice 
system Ccorrectlons, courts and police). Disseminating knowledge 
about an Innovative program which requireis the cooperation of all 
parts of the sectdr is thus difficult • (such system-wide innovation^ 
are very rare). LEAA has developed specific dissemination activities 
within NILECJ such as the Office of Technology Transfer (Rettig 1976) 
These activities include arranging seminars, visits to sites of, 
demonstration ptograms, demonstration programs themselves, and the 
provision of data about the programs ^.^LECJ April, 1976). 

This step is interactive with the amount of support avsdLlable to 
the -adopting agency. If project selection decisions are informed 
by user need identification, then selection of location for demon- 
stration programs would include consideration of the potential mar- 
keting benefits of strategic locations of demonstration proje^. 

Producers of equipment (e.g.: for police) face a tv/o phase market/ 
wherejLn they first have to sell the larger more sophisticated 
agencies (large metropolitan departments ^and/or state police units) 
and then await the word to reach the many dispersed small units 
through their contact with people in the larger .units . Marketing 
may include appearing at professional conferences to . show 
equipment or describe a new program. » 
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3> Other Dtssemiaation Activities • . 

Another dissemination ^tivity of LEAA Is the NationAl Criminal - 

Justice Reference Service,, the national and international clear- 

* "* ^ 

inghouse^fpr reports, studies, etc This clearinghouse sends 

•abstracts of documents or \:ompleted documents to over 30,000 sub- 
scribers vho have indicated thfeir special areas of interest in the 
criminal justice system. Included in this dissemination a^e pre- 
scriptive packages and exemplary programs • Additionally NCJRS will 
respond to« specific inquiries with a computer printout of all abstracts 
in that area. Information dis^emin^ed through this service includes 
innovative programs^ processes^ new e^ipment (and their evaluation 
when completed), films, announcements of training^programs and con- 
ferences> etc. (Rettig 1976). 

LEXa encourages the adoption of innovation^ on the merits of the pro- 
gram without any financial incentive through it^review of Sfee plans 
of state planning agencies, through its discretionary funding programs, 
and. through direct, marketing or innovations to the criminal justice 
sector. This is a new emphasis for this agency, one which has iin)li- 
cations for the other operations of the agency. If programs are to 
be marketed or disseminated based on jnerit rather than as a method 
of dispersing federal funds, then the evaluation process throughout 
the R/D&I system would be affected. To encourage local agencies to 
try to obtain funds from local government for innovations would 
require facts which clearly indicate the efficacy of the innovation- 
The specification of the marketing activity as a specific step- in 
the LEAA process of program development may thus havq a major impact 
on evaluation throughout that agency. ^ 



AcqixJ,9iton is the beginning of the knowledge utilization part of 
the innovation process. . This fuiictlon represents, the activities 
which the user goes through in order tp obtain the innovation. 
Acquisition steps and procedures^ have a major interaction with the 
• previous function, marketing. Dissemination strategies take into 
^account the structure and capacities of the acquisition function. 
For exanqjle-, slnce^most of the market is relatively unsophisticated 
in the acquisition fimction and usually re3|tes on the larger 
criminal justice agencies which serve as. leaders In innovation, then 
the acquisition activities of these leaders become critical for 
. the entire sector. • 

1. Problems 

• « . 

Acquisition involves: awarenenss, search, bidding, testing, evalua- 
tion -anid finally purchasing. Generally driniinaj. justice agencies 
ack the resources' and tfechnical" skills for conducting testing and 
evaluat^,on. LEAA ajttenpted to provide standards for criminal jus- 
tice, equipment through ESIP (Equipment Systems' Improvement Program) . 
lACP (the International Association of Chiefs of Police) provides in- 
,. dependent evaluation of the products. The principal impetus to ac- 
qulsition.is still iiiformal communication from the leading agencies 
to the followers: This may come from meetings, conv^tions, trade ^ 
journals or informal communications. One function of national (and 
international) trkinlhf programs such as'^Northwestem University's 
Tra££^c Institute or the international training program of the » 
Federal Drug Enlorcement Administration is to provide an opportunity 
for professionals to exchange Information' about the latest innova- 
tions in equipment and proqesses. 



® ' N 3tj 
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2 , Funds : 

A great barrier to innovation is the lack of funds with which to 
purchase the new equipment* Host of the budget of law enforcement 
agencies goes towards personnel or fixed costs such as cars for police 
or food for prisoners/ Thus little discretion is left for new Inno- 
vations. The Omnibus Crime Crontrol Act of 1968 and the agency 
created therein (LEAA) haVe ppened up the opportunity for state and 
local criminal Justice agencies to engage in acquis it ibn*of innova- 
tions (Rettlg 1976) This bill did not ci^eate the sophistication 
necessary for ^n effective process of acquisition*^ Some sophistica- 
tlon was brought Into the system by creating state planning agencies 
which were responsible for approving the expenditure of block grant 
funds. This agency both Imposed const raiiats (such as requiring bids) 
and provided some technical assistance in acquisition processes 
(^ch as standards for communication equipment).. 

To some extent^ the influence derived from the control of tbe funds 
was used to Inqjact the form of Innovation (such as requiring comm- 
unities of a certain size to join with surroimding communities in 
developing communication prograihs). ; The LEAA office in Washington has 
more, control over recipients of money which is directly controlled 
by the agency's discretionary funds program arid iresearch program. 
Specific acquisition procedures may be inposed regarding bidding and 
standards. Acquisition activities in the program, procedure and 
process area are primarily driven by awareness of an existing inno- 
vation rather than awareness of a need. An exception might be a 
highly visible critical ^^nt which demands Immediate response ~ 
a series of killings, an assasination, airplane hlghjackings, etc. 
More t3rpical is the situation where a lead agency (e.g.: LAPD, 
California prison fystem, Massachusetts juvenile system) develops 
an innovation; and the acquisition process consists of adopting the 
lead agency's Innovation, Programs such as Work Release and the 
Des Moines project were promulgated in this manner. 
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3. Courts 

•• ' . \--^ 
A special problem exists in the court area of the criminal justice 
system. L£AA funds and attendant requirements were viewed as a 
possible violation of the separation of powers provision of the con- 
stitution, so the courts generall^^efused to apply for LEAA fun<^8. 

Recent legislation, amending the enabling law, specifically elim- 
inates various constraints to the use of LEAA funds by the courts 
(e.g.: changing a lot of "musts" to "would be encouraged to" and 
exempting the court's programs from control by LEAA) in the hopes 
of alleviating the court's hesitation towards the use of LEAA funds 
for needed improvements. 

.0 

4. Other Problems 
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One of the major barriers to acquisition might be differences in 
value systems as to^what constitutes a desirable innovation. Es- 
pecially as regards innovative programs, the* same program may be 
viewed by one sector as "coddling criminals" and by another as 
"cruel and unusual punishment". For example, in some parts of the 
U.S., the concept of indeterminate sentencing (e.g.: 10 to 20 years), • 
a California iitoovation, is now being viewed as more punishing than 
a flat-time sentence (e.g.: 18 years) with time off for good be- 
havior (thus, a sentence could be only 9 years ^ctual time). 

Perhaps a major stumbling block to the acquisition^le>rocess is the 
fact that: nearly all criminal justice agencies are under the auspices 
of a unit of government, and Consequently do not have direct control 
over their purchasing processes. Rather, they must either get approval 
to acquire through the initial budget process (having an item listed 
iti their appropriation) or they must obtain^a special appropriation 



for ^hat purpose. As we have indicated, the level of sophistication 
ancmg taser agencies is generally not high. However, it is usually 
much less among the non -criminal justice government employees respon- 
sible for the flow of funds. Consequently, altholigtT a police agency 



may feel that an Innovation would be of great assistance to'its 
operation, the purchMlng department, city councillor budget direc-^ 
tor might substitute Items (thinking tha^the need can be dbt at 
lower cost). 



The bidding process often reduces rather tain encourages innovations. 
Vehicle manufacturers may attenqit to produce a vehicle in their line 
for law enforcement use. This vehicle Is i^jdlfled to increase safety 
In high speed pursuit, yet the bidding procete may frequently ell- 
Mnate such vehicles due to additional cost for the modifications. 
Unless the users can convince the purchasing department that it Is 
necessary, the innovative vehicle is unlikely to be the one selected. 



. , ^ ■ r 

XVI. ^ nfPLEMENTATION/UTILIZATION 



Ideall}^, the potential problems of this stage of the R/D&I process have 
• been considered all along the way. The capabilities of the user (who 
could in' some cases also be the developer) to Implement and utilize 
the innovation could affect research, development, marketing and Requisi- 
tion decisions. Although suqcessful business concerns would be un- 
likely to engage themselves in the creation of innovations'^ that are far 
too sophisticated for th^- intended users, government supported R/D&I. 
systems may engage in this -activity in the hopes of providing leader- 
^ship to improve the technical competence of the users. 

'C • " — 

In the criminal justice sector, the tyf% of innovaton which requires 
sophisticated technical skills (Wilson & McLaren 1972) may be a^, new 
coimnunicaitions syistem or an operations research application to patrol 
scheduling (e.g.: randomizing the time when an area is patroled) . 
These Innovations may require a structured implementation plan, perhaps 
using implementation technology such as PERT (Program Evaluation and 
Review Technique). Activities involyirig bx>th producers and users may/ 
include: hiring new staff, training, designing and acquiring supplies: 
and forms, perhaps some organizational development interventipns to 
overcome resistance to change, preparation of facilities, actual in- 
stallation, testing and debugging, trial run and finally, monitoring, ' 
.evaluation, feedback and modification. The end of this stage may be / 
marked by a formal acceptance of the innovation on the part of the user. 

An innovation about a new sophisticated (in a b^avioral science manner) 
method of working with juvenifes or adult offenders (such as the appli- 
cation of behavior modification techniques) may require the same type 
of training and careful planning to be properly implemented. • 



1. Approaches to Implementatlori/Utlllzatlon 

Fout strategies are prlmaHly used to encourage the use of criminal 
justice innovations (Yin 1976): . " 



1) 




3) 



Specific innovation — the promotion of special specific 
Ppoie^s through selective funding of grants . 



2) Using intermediary institutions such as 'the police founda^ 
tion and the Vera Institute to promote implementation and 
utilization by users who have a positive relationship with 
these institutiohs . 

User agency R&D units concerned with immediate problems. 
These units are short-term- in their orientation, but since 
they are responding to agency identified needs, use of rfe- 
search findings is not unconimon . • . 

A) . Dissemination of written materials to users regarding R/D&I 
findings. • However, "all of the traditional strategies 
appear to have some serious shortcomings and may not hold 
great promise for the future. One reason for the dlffi- 
culttes may be' that the traditional strategies have been 
aimed at the wrong target group — i.e., the local service 
practitioner agency . . . they may be more effectively 
applied if addressed to other institutions that . .1. have 
a potent influence over the work of local service agencies." 
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Possible alternative points of entry, those with "potent influence", 
include institutions concerned vith training, certification, devel- 
opment of new legislation, professional activities and the organ- 
izational function of the local bureaucracy. More specifically. 
' (Yin 1976): - 

1) training: police academies, law schoftl^'^nd otiier basic 
(and often mandated by law) training^^^gy^iins ^ha't reach ' ' 
candidate practitioners; 

■ ■ 

2) certification: ^both initial and promotional exams — civil 
service or other; ■" 



3) new legislat^n: making legislators aware of innova- 
tions in the field; 

4) professional activities: using professional associations 
to disseminate R/D&I fnformation to users; and 



:ion 



5) organizational functions:,^ assuring that R/D&I informatic 

is received by the organizational decision makers (e.g.: the 
individual who decides whab equipment to buy) . 

•Some .significant implications to these alternative strategies have been 
postulated. For example, Yin (1976) lists: 

"...a less direct link between a specific research project and a ' 
specific change in criminal lustice practice." N 

• ■ * "1 

"...there will be* a much longer time-lag between the R&D activity 
and Che eventiial^instailation of new pr.actices." 



"7 

"...RiD Utilization strategies will be aimed at different target 
audiences." ^ s 

; "the use of natural entry points does not preclude coptinued use o 
certain traditional utilization activities/! > 

These implications when coupled with the components of -the institu- 
tional analytical process — barriers due t^ a lack of R&D history, 
weak bonds between elements In the R&D user system, weak 
bonds between the R&D institutions and users, and statutory limits 
on R&D institutions* roles and responsibilities — may be the reason 
for continued use of traditional strategies in the criminal justice 
system (Rettig 1976). , 

NIMH's Center for Studies of Crime and Delinquency uses two approache 
to obtain utilization of R&D results — an information program dissem 
inating monographs and reports on both topics and^'^issues^and a rese^ 
utiliaaation strategy specif idally developed for selected projects., 
NILECJ's approach is similar. "The underlying logic within NILECJ 
for research utilization is to systematically package the results 
for the research program and disseminate them widely to the criminal 
Justice community'^ (Rettig 1976). Three approaches are used to 
accomplish this: the National Criminal Justice Reference Service, 
(an 'international clearinghouse for researchers and practitioners 
with over 30,000 subscribers); exemplary projects; and prescriptive 
packages. Additionally, NILECJ's Office of Technology Olransfer pro- 
vides short training programs on a limited basis for prog^^ams of 
special interest . While the OTT is building considerable redundancy 
in the coismunlcatlon channels to prospective users, "given the com- 
plexity of institutional relations in the criminal justice policy \ 
system, the establishment of communication channels and networks is 
itself of great potential importance" (Rettig. 1976). 



2 , lEaplemantatioa/Utlllzation. Issuei^ 

■ ■m ') . ...^ . 

Establlshit}^ a new c6mntunlty corrections program may require site 

selection, hiring and training 8ta££|;, new forms, new procedures, 
sel-ectlon o£.ijpart;lcipants and the skills required to gain the sup* 
port of key^^^i^:(:sons such as the locai police, neighbors and perhaps 
the.qourt. The skills to accomplish the latter may be Just as 
scarce, as the. itechnlcal skills discussed previously. Another ptogram 
may r<^«ilre cmnunlty organization skills to Implement (LEAA's Com*- 
munlty^ntl-C]^lme Program). Implementation problems may be great 
harvte'q^ to lij^vatlons In the area of equipment or sophisticated 
systemsv Tnfese^ difficulties may prevent the producer from ever 
gettliiJ^nvolTj^d l(k this sector. Regarding Innovative programs, 
often little consideration is given to implementation problems; 
and the time ^^cessar» to get a new program running is often under*- 
estimate^ for^hi^ reason. Utilization can become a problem, es- 
pecially i£%upport is withdrawn after the implementation process. 

• * • • O \. V 

In criminal. Justice, there is often a/great deal of enthusiasm attendant 
with an innov«io^\ bringing along a great deal of support both internal 
and e^ernal.l^ The user agency may be particularly responsive to the 
impl^lnenting staff; but once the newness oyer, this responsiveness 
ma^^i^^^ar, along with the handplcked s.ta^f which performed the 
implementation pilot test. SustaintLng support may be lacking both in- 
ternally ^nd from the producer. Unless sp:lecifi{c mechanisms are set up, 
diffusion within the user system may not occur, inhibited by Jealousy 
or poor communication. \' ■ 

The large urban elements of the criminal Ju'Stice sector have less 

'\ . » ■ 

problems with implementation and utilization since they are likely 

to have specialized staff to be involved on a full time basis. They 

may also have a much closer relationship \rLth the producing institi^- 
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tlon. The producing Institution may be wlllln^to Invest more effort 
In the dLmplementatloi^ of a large, system since the sale will be larger 
and follow-on benefits are likely If the large agency Is considered 
a leader by the smaller agencies. LEAA and the sub-agencies created 
by the enabling legislation (8tat:e criminal Justice planning agencies) 
^^lll fund agencies to allow them to purchase Implementation support. 
They also provide scnne direct technical assistance. When preparing 
Instruction? and manuals for new programs, the need for language 
which will reduce implementation problems is taken into consider- 
ation (specific dtep by step instructions and check |.lsts may fa- 
cil^itate Implementation) LEAA encourages 'C lose association of users 
with the "producer** in a ^ituation of trjring to encourage the dis- 
semination of an exemplary program (for example, the Vera Institute's 
bail program or the DesJUoines Community Corrections Project). 




5/^ 



4. 
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XVII, SUPPORT SERVICES V i\ 



Research /Development and Innovation systems require support from insti- 
tutions outside of the system or marginally within the system. Such 
research support service include: research libraries, suppliers arid 
maintainers of: laboratory equipment, computers, offifce equipment, 
automobiles, weapons, etc.* R/D&I system Institutions must decide 
whether or not to develop the needed capability within the system or 
to acquire 'it from an outside support service. The criminal Justice 
Research/Development and Innovation system relies extensively on 
institutions outside of the systein or those which span several sectors. 
Many jcrimlnal Justice sector Innovations involve technology transfers 
across sectors. Sometimes these attempts fail when inadequate atten- 
tion is given toKthe unique aspects of th^ criminal Justice sector.. 

1. Problems / • > , 

Various programs at^mpted under the NILECJ Equipment Systems ImproVfe- 
ment Program failed to &r:^ng (instx^utions from other sectols into the 
program (Radnor 1975) L In maim of Wie R/D&I system fiiSctions, the 
institutions>»re_lnvolved only An thfe fringe of the criminal justice ^ 
sector, with most of their Vork\^ein]^done in other sectors. Weapons 
may be principally designed for defense, with law enforcement being 
a secondary market. The lack of qualified consultants in the area of 
implementation in law enforcement is a major weakness of the system * 
(Radnor 1975). Many universities play roles (e.g.: Northwestern 
University's Traffic Institute in training). LEAA has played a 
role in invloving external instltxitlons in the criminal jus-clce 
R/D&I system by providing the funding and serving as a linking 
mechanism to encourage the participation of these sector spanning 
agencies. There has been some notable success in this area. Motorola 
has developed a line of equipment expressly for criminal justice 
communic^Uons. " , ^ 
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Finally, a great reliance on the public sector exists since the fall 
ur^ of Che criminal Justice system has a significant negative %ffect 
on citizens as more of them become victims of crime. Consequently 
there is a major effort to involve private citizens in the R/D&I 
process. 

f 

2. Other Issues'^ ^ ' 

The above are by no means exhaustive, merely^ref lecting soine of the 
needs of the process and activities of the R/D&I area. Foi^ example, 
Daniel Bell (Bell 1976) categorizes task which would provide oppor- 
tunities for a greater degree of public participation. This in 
turn is perceived as a useful means of addressing critical issues 
in the area, since these ^task forces would represent constituencies * 
which are not found in the established crimini?! Justice R/D6el net- 
work (advisory bodies; fact finding bodied; public relations gtoups 
policy recommendati^on groups). Such groups would provide relevant 
^ input into the foci of R/D&I activities. 

In the area of personnel selection/recruitment /training, external 
agencies and private organizations can assist in the search fo^ 
qualified staff. University groups or external advisory bodies 
can provide services in reviewing new proposals (peer review) . 
Nongovernmental agencies/individuals serve as technical consul- 

In the case of particular research projects which involve human sub- 
ject's, review boards (e.g.: of universities) provide services in 

itei^s c^^etisu^ng 4:hat proper procedures have been followed in ob7 
tainJg^is^Lnformed consent of participants. Such boards judge coin- 

^^lifi^^W^tjh* established national guidelines. 

■ ^ 

' Communication mechanisms to involve these types of external groups 
are essential to the adequate functioning of the R/D&I activities of 
the criminal justice sector. 
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XVIII. EVALUATION RESEARCH • . y 

Tt)6 phrase evaluation research Implies evaluation conducted In^such 
a way as Co expand the knowledge bade. A single function In the R/D&I 
process 'zay be evaluated as may the entire process, and evaluation as 
a specific activity Is vital In several functions of the process. 
In the research generation stage » e'Vftluatlon made by tests of the 
Innova^tlon. In the development stage, evaluation Is made of the re- 
vised product. In the marketing stage, the evaluations gained from 
^^^^he prior tests and demonstrations are Important data to utilize In 
• the promotion. of the innovation. The user evaluates the effectiveness- 
^ add and efficiency of the litnovatlon, while the researcher or lead 
federal agency may wish to evaluate the entire R/D&I process. 

1. Problems • , " 



In the criminal Justice sector, eivaluatlon has. generally beei\ neg*^ 
lected.. With the advent of federal funding In 'the late 1960s 
and the evaluation re'^fulred by the enabling legislation » this func^ 
tlon received more attention. The Implementation of criminal jus- 
tice was Impeded by difficulties which plauged social programs in 
many sectors. One .problem, which frequently occurred in the evalua 
tlon of federally funded innovations, was that the grantees often 
did not concern themselves with the issue of evaluation until it 
becaipe time to request continuatJ.on funding. Thus evaluation peopl 
were not involved until just before the end of the program. At 
that point: it' was virtually impossible to^conduct a good evaluation 
since inevitably the data needed had not been collected. Anotl}er 
problem emerged in the cases where evaluators»were brought in early 
^.n the process. Here, the* desire of the evaluators to "heip" 
causes two difficulties. One is the well known issue of the 
eValuaCor being coopted Into given a favorable report on what 
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the program looks Ilka now that he has redceigncd It. The 
other less discussed point Is that the program person may not 
£^1 free to disregard the evaluator's suggestion for fear of 
Incurring his anger or at least an told you so" posture to- 
wards the program, particularly when refunding Is an Issue. 
Even evaluators ulth great Integrity have not always been able to 
resist the temptation ot Interpret the results in such a way 
as to accentuate a failure which. In the evaluator's opinion, 
might not have occurred if the program people had listened to the 
evaluator.^ One w4y around thls^ difficulty may be to use different 
^valuators for formative than for summatlve evaluation. There hds 
been an attitude in some areas of criminal justice that impact 
evaluation is not needed ("We know what needs to be done") ani 
only process evaluation is desired (finding out if the program has 
been inplemented correctly), 

^ ■• 

The, Task Force on criminal Justice R/D&I report identifies specific 
problems with criminal Justice evaluatlqn^uch as:, methodological 
deficiencies, failure to collect process information, failure to 
use control groups, failure to plan for evaluation and failure to 
disseminate evaluation results (TFCJR&D, 1976). 

2. Meaning 

There ^^Iso seemsnto be some confusion about the meaning /of various 
terms associated with evaluation such as; evaluation, evaluation 
research, monitoring, and research. There are statements in LEAA 
documents that evaluation of demonstration does not need to be as 
rigorous as evaluation of a test. Such statements imply different 
types of evaluation for different functions in the R/D&I system. 



t^at evaluation takes place in the ciminal justice system is funded 
by or sometimes performed by LEAA, either the Off left of Evaluation 
in NILECJ or the program offices in the Office of Criminal Justice 
Programs. The evaluaticm-ftstaff in the Office of Planning and Manage 
ment develops the LEAA evaluation plan which identifies the programs 
^to*e evaliiated during the upcoming planning period. ^ 

3.^ Criteria 

An overarching dif Acuity which pervades the entire criminal justice 
sector (not only the R/D&I system) 1^ the issue of which criterik 
to use for evaluation. LEAA itself is caught up in a debate between 
advocates ot a criteria of reduction of crime and of Improving the 
criminal justice system (Blumstein 1965). Fuzzy criteria such as 
aid- in improving the ysytem are virtually unevaluatable. This diffi- 
culty is often resolved by lowering the^level of the , evaluation to 
some process criteria such as*^ grants made or programs initiated. 

Upgrading evaluation to include such impact criteria as reduction of 
crime is fraught with political risks, tt has to be recognized that 
crime is influenced by so many other variables 4:hat crime reduction 
may be an inapp'ropriate measure of ef f ectiveneiss. This position, 
however, could be fatal to an agency which^|,s expected by Congress 
ancj the public to "reduqe crime". * 



Among; the evaluative factors or measurement tools tha^t could be used 
in the criminal justice sector are the following (TFCJR&D 1976) : 
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Change in the number o'f crimes ir^ the area 5.n which] 
technology is used; ' 
change in economic loss resulting from crime; 
change in the number of deaths and personal injuries 
resulting from crimesf ^ 
change in psychological harm. I 



- change In the auznber of suspects arrested or convicted; 
, ' - more or less efficient use of manpower; 

- .jchange in equipment reliability and/or ease of use; .and 

- change in the i^vel of citizen fear of crime.' 

However eve|i these factors have basic and Inherent weaknesses as 
evaluation criteri^a, Fc^ e:]^ample^ in the evaluation of a crime pre 
verition program, it may be noted that there has been a significant 
reduction of the targeted crimes wttthiti the area that the program 
operates. Further analysis may well" demons trat\i that there has 
been no overall^ reduction of crime, but rather "geographical dis- , 
placement^' — that is * the^ moving of crime from the jurisdiction 
in which the program operates to a neighboring jurisdiption without 
such a program. Consequently the questic^ 6f whether there would 
havie been -a crime reduction if the program were comprehensively^/ 
applied iix all jurisdictions remains unanswered. ' / 
■ ^ ' • ' , \ ■ 

4. Standards ^: 



There are significant gaps in standards needed for criminal justice 
evaluation. Existing evaluation research tends to e&IpAasize evalua- 
tion of tecfenoiogy or laboratory evaluation, and the development of 
ideal performance standards for existing technology (l^FCR&D, 1976). 
The evaluations do not tell whTBtheB^products already in use meet es- 
tablished standards. Fiirthermore, the standards that are developed 
often do not reflect the differing needs among agencies. For exampl 
standards regarding communications equipment may eliminate equipment 
that would not be effettive in hilly country. Yet for law enforce- 
ment agencies in the plains states, a purchase of "below standard" 
equipment (at less cost) may achieve the required level of equipment 
effectiveness, since there is no hilly country within the user 
agen,cy*s jurisdiction. 

" ' * <^ 

In one sen^e evaluation completes the R/D&I process as the final 
activity, in another sense evaluation may be a beginning as it 
triggers^ the process to searph^for a better innovation and provJLdes 
the feedback Ipop to a new innffvation cycle. , » 



r. ; : 

In the. crlailnal justice' sector, research on the R/D&I systew^has 
primarily^taken the fqrm of distillations of expert anslys-is and 
opinion. There "review of the situation" type reports (Twentieth' 
Century Fund Task Force 1976 & National Acad einy of Science 1977) 
have been based on interviews, site visits, archival records, and 
discussions among panels of scholars. Like the Report of the Task 
Force on Criminal JusticeVResearch and Development these reports 
contain prescriptive recommendations. The NAS study of NILECJ 
(National Academy of Science 1977) Is directly R/D&I related, and 
Is. again more descriptive and prescriptive than analytical. 

Recently, there have beeto specific studies oa aspects of the R/D&I 
system such as the Lazar Institute's Extem^Revlew Mechanisms • 

(Lazar 1976). These also: follow the above format of description 
and prescription. 



Finally there have been few actual research studies on aspects of , ' 
^ R/D&I. One was conducted by Northwestem'^Univfersity''s Center for 
the Interdisciplinary Study of Science and Technology (CISST) on the 
Equipment Systems Improvement Program o>^NILECJ (Radnor 1975). This 
ptudy was university based and analyzed /he nature of the R/D&I system 
as it related , to criminal justice equipmenp. This study analyzed the 
entire process for need identification through possible qommerciali- * 
•zation of innovations, discussing each step" of the process 
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^ 2. Frobleins C - 
■ * - ' . 

One of the impediments to analytical research on R/D&I in this sector 
is the lack of unifoAi definitions among the various R/D&I projects. 
The absence of a common terminology makeis con^rative analysis diffi- 
cult iat best, and leads to the. descriptive/prescrip^ve research identi- 
fied above/^ A factor that contributes to, this impedime^ is that 
R/D&I in criminal justice is performed by a wide variety of sectors 
other than criminal justice. . As ""the section on the personnel base 
points out, the rapid growth of funding for criminal justice R/O&I has 
resulted.- in an equally rapid growth of the nuiiber of disciplines with 
"something to offer." ^ ' ^ — 

Another impediment may well be the disparity in user groups. As pointed 
out in the preceding sectloa^ user group iday .w^l range jfrom schools 
(for prevention programs) to corrections (for rehabilitation programs). 
^This lack of a singular "mission" that is agreed upon even within the ^ 
criminal justice system itself, much less by the tangential systems 
stfch as schools, social welfare agencies, economics, etc., makes it 
difficult for prospective researchers of -criminal justice R/D&I to gain 
encouragement. 

The above leads to the conclusion that research of criminal justice 
R/D&I has not been a priority within the system. This may be for a 
ninnber of reasons in addition to those above.. 

Research on R/D&I is a new field while the concept of R/D&I itself has 
only recently gained acceptance, and that on a limited basis, within 
criminal justice. Users and f under s (in a system primarily oriented 
..towards problem- focused research)^ tend to see research on R/D&I as - 
seeking knowledge for knowledge sake, rather than as a means of im- 
proving the utility of the R/D&I being performed. ' Users particularly 

see research without a readily applicable result as a waste of funding 

> 
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when they consider themselves short-staffed, and that their needs could 
well>e satisfied with existing technology. A police chief using com- 
nutxic^tions equipment purchased in the 194^^ who depends on a "frugal" 
city^ cojincil for appropriations, may be well satisfied with equipment 
representative of technology of the 1960s, and njay want funds used to 
buy that, rather than spent on further development of innovations.* 

. ' ■* ■ ■ '■ 

Still, there has been a recent trend towards research on R/D&I,^ indi- 
cated among other things by the recent task force study (TFCJR&D), by. 

Rettig Cl976), the NAS (1976) study, Radnor (1975) and the very ^ist- 

* " it 
ence of this document. As the R/D&I concept gains ^ncr eased accep- 
tance within the field, research on R/D&I may benefit and gradually, 
become more analytical and sophisticated. As a contribution to. fhis 
cause we have developed, and attach, a rather tiiore extensive biblio- 
graphy on source materials than any we were ab Id to discover -in our 
research for the preparation of this 'review. ^ * 
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. - CHAPTER SEVEN 

AN ILLUSTRATIVE CROSS-SECTORAL • • 
COMPARATIVE CONTEXTUAL ANALYSIS 

In the previous four chapters, we have Illustrated how the CXSST con** 
textual analysis framework may be used to describe the overall context 
for R/p&I in four sectors: education, civilian aviation; health and^ 
criminal justice. 

While a full cross-sectoral comparison would be beyond the intended 
scope of this report » there is merit in providing, here some insight 
into the process and utility of cross-sectoral comparative analyses ' 
beyond that whichvth^^iw^er could glean from separate readings of 
Chapters Three V^^^HB^ ifhus we have chosen to present here (in 
a table format) a Qeffibar^tive summar^ of these four contextual analyses. 
The more detailed discussions in Chapters Three through Six should 

atat€i understanding of the brief summary context descriptions 
ed in this chapter. 

This chapter y then9^^s]]iould provide some insight into the similarities 
and differences between sectors — and by so doing, provide some 
insight into the process and utility of comparative contextual 
analysis of R/D&I. 
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I Htitorietl Devtlownt (Continued) 
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Increased efforts 
towards linkage 
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ERIC 



HeiltN 

Crtiet kttovltd|i 

producti ' ' I t 
Ef(«etlv«nMi rtthtr 
.thin cpifrcrl^^rl*' ' 
<Moie uif'ii art th« , 

en " convlnfti; thwf 
Enphiili hii be^n 6q 

euri;ng. mher thin 

'preventing dlmii 
^Inf lii^nce io£ .external 

icrohg 

^eeth vi, other problena 
.Congi'eeaiRen are lA 
fluentlal .1 

■J • • 

. " " 



fcrialhil Juitlca ' 

Unclear goala of C.J. 
lector 

vDlverilty of prl«rj:tlei 
' Dliigreenent'.on value 
of equipment and L 
lyitena vs. loclal 
iMuea 
Competition for rei- 
• oiircaa 
Role ofl NILECJ 
Produebr of R&D goali 



'I ■ f 



t 



Clvillin Avietlon 

Eeonooy, maintenanee, 

nolle, pollution, 
' ipeed, range vs. 
military performance, 
payload , 

NASA/producers/uaeri 
' ipectrum 

Time horitons shorter 

operations 
Costs go up 
Increasing role 
Clear 'specialli 
External environ 

effects 

Energy 

Environments impact 
Costs 




Education 

Weak goal,>8etting 

Federal policy goals — 
Improve education 
practice and know- 



In practice 

Discontinuous shifting 

priorities 
. Inconsistency 
lack of Intermediate 
goals 

Lack of mechanisms to 
develop goal consensus 

1950's and 60's goals 
set by educational 
research cosunuplty 

Mid 60*8 -r central 
'programmatic R&D 

Short time horizon 

Externally defined 

Emphasis on development, 
packageable produces 

Build regional' labs 

NIE increased emphasis 
on improving practice, 
dissemination, im- 

■ plementatlon, utili- 
zation building user 
capabilities . 



CrliiMl Juitlc| ^ 



I 

Civilian Aviation 



Education 



Canwtl/raaearch/daval 
pent 

Sophlitleation of id- 



Large nuabar of lathoda 
apeelflcally for 
aeroipaea R&D 



Has not been area 
of oftjor concen- 
tration 



niniitratlon varlei ^ Suceeaa nay be context 
ProductionVinarketln n / related 

dlatrlbutlon varies 

with organlmion 
Acqulgltlon/linplenienta - 

tlon/utlUgatlon/eval - 

uatlon 
Leia variability 
Generally lower level 
, of sophistication 
Barrier to adoption 
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ttUr^l ^uitlM f i.icivlll«nAvl,i:tr.n Education 



Ui«r OrMnliiCioni ' 
Labor Inttnaiva 
feraonnal li obataeii- 

to innovation 

adoption 
Create: apecialliation 

can lead to greater 

adoption rates 



' Large (iinberi of idence 
and engineering and' 
other highly developed 
^ ekllla 

' Skill nix and coneei^tra- 
j / tlon critJ^cal 

High rate of obsoles- 
cence of skills 

Research labor levels 
. .'fluctuate with 

j economic londition 

r'bility high within 
sector 



MD 

Snail overall base 

Concentrated in 
research, develop- 
ment and evoluation 

Inadequate in dis- 
sealnation and inp- 
lenentation/utiliza- 
tlon 

Research orientation 
derived from acade- 
mic project research 
rather than program 
development 

Inadequate supply of 
R&D managers 
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Hulth 

SpoBiorthlp fM73) 
•Fidaril • 60Z 
-Induitty - 301 
-Founditlooi «• 5X 
•Vpluntiry heilth 
agMcitf • 3Z 

3.S bllUoa 

Ffldtrftl funding donlnAnt 
In btilc tad eUalcal 
ruearch 

Kadlcal profasilon 
doalnates the ln« 
fluence on alloca- 
tlona 



Crtolnal Juitiea 

Budgot lavali and 
proeeiiai Inpada 
adoption (budget 
primarily labor-* 
inteniive) 

Prtvaca fundi not 
encouraged by per- 
celvQd charac;teriitlci 

' of the Wrjcfii 

Fedelil ^ov^rnoenl 
dooinai^t ^durce 
of R&D funda 



Civilian Aviation 

1958-1968 , 
Federal - 5 billion 

a year 
Private - ^ to 1 

billion 
Long tine ipan from 

research to $ 

return 



Education 

Federal govemaent 
primary iponior 

4 veatoeaaes: 
-concentration of 
aponsorship 
-anount of $ 
-diffuaion of expen- 
diturea over broad 
apeetrun of projecta 
-Inatabllity 

Smaller percent of 
Grosa National 
Product than other 
sectora 



I 



8. iBforaitiftn y|<iif 



Crlalnil Juitlfii 

Uttral triaifir it 
uitr and rtmreb 

Liif froB reitireh 

to user 
Uier organisation! - 

Infomal 
Pariodlcali 



CMllan Aviation 

Raiearch livil fnt 
and my 

Devalopnent/produetloQ 
li proprietary 



Education 

3 Inforoatlon 
lysteni 

- R(D ^>R40' 

- uier --^ uier 

- external UD -> 

uier 

'All weak and Inauffident 
Media 

Annual neetlngi 
Publications , 
Not enough infonal nets 
Each system has barriers 
No policy or Inter- 
ventions directed at 
info-transfer improve- 
nent 
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Kodiritt lumber 



'I 

Vlilbli iDoovitlona 
tind to eoit in 
viry lirgi eoatly 
product! but thert 
an ilio uny hlddn 
Incrmatal ^provi- 
■inci to exiling 
•qulpMnt tnd lupport 
•yitiu ' 



Educitlon 

Producti tbat |o 
through a forial 
prociaa of davalop- 
Btnt have high 
davalopnljnt ^09ta; ' 
laaa ixpknalve tot 
practice baaed 
davelopfflenc 

"People-change" pro- . 
ducta' - iBpllca- , ' 
tlon for Inple- 
nentatlon (product/ 
user reactlveneas) 




10. Hud IdtB^fff^i^inn 



CtImImI Juitici 
AnyoM cia 

Not ptrformd uniformly 

by uitri 
'Both product tvilUblUty 

Md probUni iffict 

proeiii 
' But lelMvaluitloh by 

deparcmnti li weak 
Extirnal prii«uni 

of tan ipark naedi 
Littla Mrkat raiiarch 

(excapt 2-vay con- 
^ Bunicatlon) 
(^tajdara find It hard 

to naad IdaQtiflcatloa -< 

don't undoratand C. J. 

oparatlooi 



Civilian Avtitlon 

Producai^'itlBiulata uiir 

naadi (ai veil n niid 

idantlficatlon) 
Airlinai atioulata oon- 

luoari* 
Aircraft cloia contact 

ultlnata public 



Education 

Weak ■' • 

Mostly apiaodic, tunad 
to funding 

Scattered throughout 
R/D&I 

Lacka fomaliz^tlon 

Intuition 

Opportunistic 

Little data-basad, 
but increasing 

Vary little trans- 
lation into specific 
K/D&I requirenents 

Vague statenents 

Unable to create 
integrated KF/IOI 
perspectives 



sis' 



■ \ 



llolo|lcit idinet 

but phyiteil 

lelincffi eoMlflg 

In and loclil 

•elineti 
Tetil lyitin of bciltti 
(hoUittel 

Ub ind flild (inercif 

ingly) , 
Rl|h eichnology iqulp- 
Mnt 

lack of Intairation 
aeroaa aagnanta of 
th^flald; varlaty 
of aatttnga; uauaUy 
anlnala 



Craat varlaty of 

tiehnoloilaa 
?roblaM vith Tach* 

nology tranafor 

vidaly dliparaad 
fadarally fundad laba 
Vary litcla rola for 

unlvorilcy 



CtvtUaw Aviation 

Seltnn baiad 
^lndaMntal 
?hyaieal aelaneai 
(Unlvaralty), MA8A, 

m 

Vaboratoty and flald 

raaairch 
larga aoala faelUtlaa 
Taana (larga) 
Accumulation of datallad 

advaneaa 
Fait publication 
Mtiaion orlantad 
Excallent raiaarch 
Envlronnant 
Product and progran 

matrix organltatlon 
Raiaarch atopi at 

prototypa itaga. 



Education 

Relatlvaly aiall 
anouoc ot adu- 
cation practlca 
^a baaad on ra- 
iaarch; la rathax 
ftora incultiva 

Poor dafinltiona of 
quaitioni 

Low rigor; inadaquata 
grounding In theory 

Methodology iaauaa 

Froblaaa: ' 
Cooparaclon betvacn 
dliclplinea 

Dcteralnation of , 

priorities receivaa 
relatively littla 
aupport 

Ethical isauea 
i Control of '^research 
' autonomy « 

Hoatly fleljl riaearcb 

Research moving out 

of university 



ERIC 



nc on huain pAClenc 
it ^eirctf. 
ne in hosplcals 
tfare pAtlents 
lot Cescltig 



pifflculciet In com- 

nerclaVlsatlon 
. Impede development 
loportent potential 
role of small 
producers 



12, D<vele?sent 



Civilian Aviation 

Mo8C' complex 
High cost 
Prototype 
Critical stage 
Not always clear 

output 
Complex iBultl* 

depai^tnent 

process 
Ends vlth flight 

testing 
High, technology 

transfer from 

\nilltary 
Cultural aspect 



Education . 

(a) Use Che engineei 
model In formally 
defined development 

(b) But lot of informal 

(c) FollovB formal se- 
quential^ steps to 
field 

Large scale » expensive 
projects 

.Much practice-based 
development ; not 
rigorous developoiebt/) 
model; little fi^ld^^ 
testing; little 
systematic evaluation; 
often not packaged \ 
for generalized usa- 
bility;' less expensive 



v. 
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13, Production 



m 




production considered 

1) .manufacturing aup- 
pUea & equipment 
and, 

2) providing aervlcei , 
directly to consumer 

Quality primary concern 
of production - more 
than, cost or price 

Several sourcea of 
quality standards ' 

' and evaluation; 

1) FDA 

2) Frofeaaioflal stan- 
.dar(is:Seylev Boards . 

3) American Hospital 
'Assoclition 



Criminal Justice 

Producers generally 
cautious about 
making commltaen't 
to C» J. especially 
for innovations 

Very £ev production 
standard!! or specifi- 
cations for most 

''product areas 

Most producers of C* Ji 
innovations are in 
C' J. as a secondary 
market'/ 



tr 



Civilian Aviation 

a _ .' _ ^ 
Prodjiction is in 

|.ri)i^nt ' 

firoduchon control is 

'•' ciii^tomer oriented ' 
in design adapta- 
tion, delivery, etc, 

long lead times in- 
volved In production 

Prbdvctlbn of major > 

^ jvpJroduct (alrpttaes) 
involves one prime 

• producer & many sub- 
contractors for sub- 
assemblies and sub- 
units 

Quality control^ 
central interesf 

Complicated by com- 
plexity of produetii 
and assembly process 




Education 

Most producers of , 
education products 
are not primarily 
education oriented . 
(similar to I.E.) 

Production not a major 
issue area in edu- 
cation 

Production capabilities 
(printing, etc.) 'readily 
available 
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Health 

Health Industry has . . 
experienced groirth; 
no pr^pects for 
shop^range drops 
in growth rate. 
Increased risk-avoidance 
My put greater , pres- 
sure on prepurchase . 
testing and evaluation 
-Changes in goal-orienta- 
tion of medical practice 
from corrective to pre- 
ventive feeds bick to - 
■ producers in form pf new 
, needs and requlrenients 
and possibly, m market- 
ing strategy 
Drug marketing relies on 
personal contact with 
physicians by "detail 
user" , 
Oier eimost exclusively 
depen4entl on producer 
for information 
Producer provides both 
the infonnatlon content 
and the inforraation 
dissenination function 
[4rge hospitals are the 
innovatijpns and early 
adoptisre 



. -Criminal Jua^ fia 

Market highly :frag- 
nented in size 
variability and 
. goal orientation 

of users' 
Fragmentation impedes 
entrance of new 
producers into 
the market . 
, Producers do not 
. (generally) find it 
econoniidally feasible 
4 to sell exclusively 
' to C. J, 

Many different distr i^- 
but ion channels exiit 

Differences are often 
i/ product-specific 

Information passed on 
informally, especially 
from large to small 
users 

^ Process not well insti- • 
tutionkUzed 

Requires considerable v 
■ initiative on pWt of 
small users 

Diffuse purchasing' process 
presents formidable com- 
plicating picture to po- 
tential suppliers 

Labor intensive-very small ' 
percentage of user budget^ 
goes to innovations 



CivtUarf Aviation 

Market as a whole,- ' 

characterized by/ 
. growth 

. Users relatively ' 
sopliisticated - ' 
customers : 
Individual users ^ 
highly variable 
in adoption be- 
• havior in timing, 
creating fluctu- 
'ations 

Market needs segmented 
creating hanging 
needs for innovative 
products 

Close customer contact 
by producer^ales . 
personnel Jq^tred I 
to generate interest 
and commitment to 
justify production 
of innovative pro- 
ducts. 

User commitment must , 
precede investment 
in production 

Innovation adoption 
aided by ability 

, to dispose of function- 
al current products 
with after-market 



Educfltion . 

Function includes: 
dissenination/dif^ 
faslon, marketing, 
distribution 

Overall Impact on 
system: weak 

All receiving current 
interest by sector 
planners and policy 
makers 

Dissemination activity" 
shifted from trans- 
ferring of bodies of 
knowledge (re.search 
results) to informa- 
tion about packages 
products or developed 
practices.* 

Information dissemina- 
tion aided by ERIC 
for researcher; less 
helpful for practi- 
tioner 

Federal funding support- 
ed organizations, 

' directly Involved in 
Information dissemi- ' 
nation 

Current NIE interest in 
dissemination aimed 
at up-grading user adop- 
tion behavior. Strategy 
is: proactive, inter- 
personal, user-oriented, 
field-based network • 
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civilian Aviation 

Political and economic 
eavlroninent of the 
sector Important 
factors in the 
adoption process 



Educatloh 

Distribution 
undeveloped 



0 
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■Health 

Coneef^tracea on 

hospitals in 

ftcqulrlng nev 

tecbnologlea 
•4 faccora affecting 

«c(julsiclon "decision 
^Ij^needa of local popu- 
' . latlon, ^ i; 

2) present ser#^ 
itnictura ''l^' 

3) atatu8 

4}ava|l8billty of 
funds 

Status a major factor 
FundingN^enerally 

/ivialla.ble-controlled 
by state planning 
agencies 

Large hospitals are the 
Innovators 

Little is known|About 
the adoptlonMlsion 
process in tKoiijital 

Itandards 'for equipment 
,*re well articulated ' 
and regulated 

[ncreased risk-avoidance ' 
by purchasers ^(hospltala 
«nd physicians) will 
emphasize pre-purchase 
test and evaluation 
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ERIC 



Criminal Juattea 

Activities Included: 
l)prc-purcha8e evalu- 
,ation> 
2} testing 

3) selection of specific .. 
product 
' ^Ipurchase decision ' 
User agencies lack 
resources and technical 
capabilities for pre- 
purchase testing and : 
evaluation 
Specialization of function 
(e.g.: communications) 
tends to improve evalu- 
ation ,j 
Standards are generally 
lacking I • 

where they exl&t, they 
make evaluation more 
effective (e.g.: cora\ 
tnunlcatlons) / . 
Purchasing tied to^lddlng 
thereby requiring stand-. 
, ards 'for specifications 
Bidding also places great 

emphasis on price or cost 
The purchase decision, Is 
based more on admini- 
strative and financial 
factors than technical 
Purchasing also complicated 
by being integrated ^th 
purchasing function of 
other governmental agen- 
cies,, such as fire, 
street, etc, 
Tunds are a major 
problem 
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Civlliaa Aviation 

Search for innovations 
(new airplanes) is 
well articulated 
function-held to be 
critical function 

Pre-purchase evaluation 
and testing well 
established as process 
activities ' 

New aircraft adapted, 
for. both 

1) optimal fit with 
present operations 

2) develop competitive 
edge as "Uunphlng 
purchaser" 

Sophisticated buyers 
Cost of new airplanes 
and systemic effects ■. 
of.adoptlonyare 
forcing process to 
be even more critical 
and analytical 



Education 



.Acquisition functions 
Tlrtually non-existent 

■ is institutionalized , 

■ activity - not an ar-n ; 
ticulated and Assigned 
responsibllltyf 

No, systematic link between 

suppliers and potential 

users . 
Very little evaluative 
> information regarding 

available products ' 
Quality control not well 

exercised ' 

Standards generally lack- 
ing 

"Potential targets;' for ' 
acquisition decisions 
■ must be better defined- 
teacher, principal, cur- 
riculum specialist, 
superintendent, ot com- 
munity interest groups 

Some evidence suggests 
linkage to external 
resource systems are 

• Important factors 

NIE prcactlon - 

1) Consumer information 
I unit 

2) R&D •utilization unit 

3) Development of catalogs 
of available products; 
f^inding programs to 
provide evaluation in- 
formation 

4) Funding organizational . 
development and other 
projects to upgrade user 
ability to adopt innova- 
tions 



■1 • 
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Health 

Highly skilled user 

popuUtion ' 
Professional vi. 

adninlfiCracive 

staffs affect 

i]opleaient,atlon 
Differentiated adf' 
' option charactaristics 

of large vs. anall 

user organlutions 

(hospitals) 
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ERIC 



fiEWnaUustice 

Us" problem low ° 
level of tech-/ 
nological soph- 
istication 

Producer unUtAnrm 

ninioal-too risky, 
given low potential 
. for sales, 



0 

.1 



effects throiighout 
the user system and 
in all phases of the 
organization 
Barriers: 

-customer acceptance 
-political/legal 
constraint 
"User structural or 
technological 
barriers 
-cost 
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'functions In ed- 
ucational R/Dil 
Discrepancy between 
adoption rate and 
use of innovations 
Caused by: 

1) User norms and 
resistance 

2) Lack of technological 
sophistication: neces- 
sary to, implement 

More known about 1 than 
2 ' 

Linbge organizations 
have evolved - . 
helping educational 
organizations becl)me 
Jflore adaptive ^ 




■ : 

Health 

» 

Ulnoit alvsys avail- 
able 

tot co8t-8enaltlve 
iupport lervleea are 
concentrated vlthln 
Che aector Itself 
(Id Hospitals, 
research, phar- 
maceutical COB- , 
panles, equip- 
ment suppliers). 
Very Uttle other 
support froB, f 
sources external ( 
to these groups \ 



Crlalnal Justlea 

General lourcns: Federal 
i« yagcndes 

C. J. professional, 
associations 

Outside consultants 

Need ID ; . some by users 
nore by producers 

Generation/Research/ ■ 
Development seme 
efforts of direct 
subsidy frqji Federal 
agency to encourage 

• entry of new firm 

froduction 

Host producers are support 
.oriented 

Mark^tlng/Dlstrlbutlnn 
lACF supports by "equip- 
ment listing" distribu- 
tions; support is passive. 

Implementation and 
Utilization 

Relatively unsupported 
university institutes , 
support manpower de- 
velopment 

Evaluation 

Ci J, associations support 
development of standards 

Outside consultants directly 
evaluate or up-grade in- 

. house evaluation 



17. Support Siwio*. 

( ■ . . 

Civilian Aviation 

Some support functions: 
* -sub-contracting for v 
'<! components, equip- 
ment, and urgent 
services 
No Information on 
extent te which 
these organizations 
are in or out of the 
aerospace sector 



Education 

Equipment service 
organizations 

Printing and publish- 
ing organizations 

Survey research organ- 
izations 

Relatively little pub- 
lished literature 
about support 
functions 
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Cv4tu4Cldn crltirU 
cffecdvcMfi* 
oriented NCber 

' tiua cos( or ef* 
(iclcncy orlenCed 

Evdt,u4Clon scanJArdi 
different 
seagei of the I|/D&! 
proccu » 



Crlalivil Jmtlce 

Eviluiciofl oot t prine 
ch«r«eeerittlc oi 
, uieri « 
lack of standards and 
skill level of user 
perronnel prevent 
w developnent of evalu- 
ation as an effective 
'function. 



Civilian Aviation 

Equipment evaluation 
methodology fully 
developed - high ^ 
credibility, rigor* 
0U8 dtandar^s, sub* 
stanti^ control by 
fed,eral agency v 



Education 

Host rapid advance of 
all educational ^R/D&I 
function in last 10 
years • 

Federal fu^g demanded 
evaluation-generating 
specialization 'of 
evaluation 

Specialization takes 
place In private 
sector as veil as 
acadenla 

Methodology one aspect 

, of specialization/ 
,'Jpvaluatlon research 
';. knowledge becomes _ 
more sophisticated 

Evaluation research 
function has acquired 
increased political ' 
declsionY»king 
influenceV still 
not vldesp^ad. as ^ 

' basis for oMij^ons ^ 

In spite of 'the^evelop^ 
mcnt, evaluation re-^ 
search function still 
in growth phase ' 

Evaluation methods and 
credibility based 
essentially on social 

. science methodology 
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19.. iMMreh an B/ntT : r 



Health 

little or no 

research on health 

R/MI 

Some description* of 
conponencsi but 
data are. not con- 
parable^ 



Crlalnal JmiHi.ii ' 

Very little - juat 
beginning 



I 



Civilian AviiHftn 

No previous descrip- 
tions of overall 
R/D4I sysfeo * ® 

Systeos and techniques 
for Mnageuent of 
RSD ' - 



Educat ion 

Much analysis and 
research because: 

1) Negative political 
climate ''^ii 

2) Self-consciousness 

of, social sciences 
in 60*3 

3) International in- 
fluence 

4) Sponsors', interests 
in evaluation re- 
search for -policy 
fonnatlon. ' ' • ' 

Much literature but: 
1} Directed at A 

'nents of ch^ 

system 

2) Relatively little 
empirical data 

3) Atheoretical 
A) Little used 
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